Apr 15 23:12:43 devstack cinder-volume[72276]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 23:12:43 devstack cinder-volume[72276]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 23:12:43 devstack cinder-volume[72276]: we strongly recommend against using it for new projects.
Apr 15 23:12:43 devstack cinder-volume[72276]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 23:12:43 devstack cinder-volume[72276]: framework.  For more detail see
Apr 15 23:12:43 devstack cinder-volume[72276]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 23:12:43 devstack cinder-volume[72276]:   import eventlet  # noqa
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 23:12:45 devstack cinder-volume[72276]: INFO dbcounter [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Registered counter for database cinder
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG oslo_db.sqlalchemy.engines [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG dbcounter [-] [72276] Writer thread running {{(pid=72276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 23:12:45 devstack cinder-volume[72276]: INFO cinder.rpc [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 23:12:45 devstack cinder-volume[72276]: INFO cinder.rpc [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG oslo_db.sqlalchemy.engines [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:12:45 devstack cinder-volume[72276]: INFO cinder.volume.manager [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Determined volume DB was empty at startup.
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG cinder.volume.manager [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72276) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 23:12:45 devstack cinder-volume[72276]: INFO cinder.volume.manager [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 23:12:45 devstack cinder-volume[72276]: WARNING stevedore.named [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 23:12:45 devstack cinder-volume[72276]: WARNING castellan.key_manager [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 23:12:45 devstack cinder-volume[72276]: WARNING cinder.keymgr.conf_key_mgr [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG cinder.volume.drivers.lvm [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72276) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 15 23:12:45 devstack cinder-volume[72276]: DEBUG oslo_concurrency.processutils [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72276) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_concurrency.processutils [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] CMD "cinder-rtstool verify" returned: 0 in 0.247s {{(pid=72276) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_db.sqlalchemy.engines [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:12:46 devstack cinder-volume[72276]: INFO cinder.rpc [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 15 23:12:46 devstack cinder-volume[72276]: INFO cinder.rpc [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 15 23:12:46 devstack cinder-volume[72276]: WARNING stevedore.named [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 23:12:46 devstack cinder-volume[72276]: WARNING castellan.key_manager [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 23:12:46 devstack cinder-volume[72276]: INFO cinder.volume.manager [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_db.sqlalchemy.engines [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:12:46 devstack cinder-volume[72276]: INFO oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Starting 1 workers
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Started child 72382 {{(pid=72276) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Full set of CONF: {{(pid=72276) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] ******************************************************************************** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Configuration options gathered from: {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 23:12:46 devstack cinder-volume[72382]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] ================================================================================ {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] allow_availability_zone_fallback = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] allow_compression_on_image_upload = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] allowed_direct_url_schemes     = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] api_rate_limit                 = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] auth_strategy                  = keystone {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] az_cache_duration              = 3600 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_availability_zone      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_host                   = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_name                   = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_stats_polling_interval = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backup_api_class               = cinder.backup.api.API {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backup_name_template           = backup-%s {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backup_use_same_host           = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backup_use_temp_snapshot       = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] chap_password                  = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] chap_username                  =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_internal_tenant_project_id = bf48bf5b8be8445bb83a530d1fa3219f {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_internal_tenant_user_id = b5b7b84b3c6042d6b4928a135a055478 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cloned_volume_same_az          = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cluster                        = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] compression_format             = gzip {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] config_dir                     = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] config_source                  = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] control_exchange               = openstack {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] debug                          = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] default_availability_zone      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] default_group_type             = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] default_volume_type            = lvmdriver-1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] disk_geometry                  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] driver_client_cert             = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] driver_client_cert_key         = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] driver_data_namespace          = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] driver_ssl_cert_path           = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] driver_ssl_cert_verify         = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] driver_use_ssl                 = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] enable_force_upload            = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] enable_new_services            = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] enable_unsupported_driver      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] enforce_multipath_for_image_xfer = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] filter_function                = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_api_insecure            = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_api_servers             = ['http://192.168.122.51/image'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_api_ssl_compression     = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_ca_certificates_file    = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_certfile                = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_keyfile                 = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_num_retries             = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance_request_timeout         = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] goodness_function              = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] graceful_shutdown_timeout      = 5 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] group_api_class                = cinder.group.api.API {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] host                           = devstack {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_compress_on_upload       = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_conversion_address_space_limit = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_conversion_cpu_limit     = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_conversion_disable       = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_upload_use_cinder_backend = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_upload_use_internal_tenant = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_volume_cache_enabled     = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_volume_cache_max_count   = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] image_volume_cache_max_size_gb = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] init_host_max_objects_retrieval = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] iscsi_target_flags             =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] iscsi_write_cache              = on {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] iser_helper                    = tgtadm {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] iser_ip_address                = 192.168.122.51 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] iser_port                      = 3260 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_color                      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_config_append              = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_dir                        = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_file                       = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72382]: INFO cinder.volume.manager [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_options                    = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_rotate_interval            = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_rotate_interval_type       = days {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] log_rotation_type              = none {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] max_age                        = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] max_logfile_count              = 30 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] max_logfile_size_mb            = 200 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] max_over_subscription_ratio    = 20.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] message_reap_interval          = 86400 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] message_ttl                    = 2592000 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] migration_create_volume_timeout_secs = 300 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] monkey_patch                   = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] monkey_patch_modules           = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] my_ip                          = 192.168.122.51 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] no_snapshot_gb_quota           = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] num_iser_scan_tries            = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] num_shell_tries                = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] num_volume_device_scan_tries   = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] nvmeof_conn_info_version       = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] nvmet_ns_id                    = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] nvmet_port_id                  = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] osapi_max_limit                = 1000 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] osapi_volume_ext_list          = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] osapi_volume_listen_port       = 8776 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] osapi_volume_use_ssl           = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] osapi_volume_workers           = 2 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] per_volume_size_limit          = -1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] periodic_fuzzy_delay           = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] periodic_interval              = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] public_endpoint                = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] publish_errors                 = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] quota_backup_gigabytes         = 1000 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] quota_backups                  = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] quota_gigabytes                = 1000 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] quota_groups                   = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] quota_snapshots                = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] quota_volumes                  = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] rate_limit_burst               = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] rate_limit_except_level        = CRITICAL {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] rate_limit_interval            = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] reinit_driver_count            = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] replication_device             = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] report_discard_supported       = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] report_interval                = 120 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] reservation_clean_interval     = 86400 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] reservation_expire             = 86400 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] reserved_image_namespaces      = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] reserved_percentage            = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] rpc_response_timeout           = 120 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] run_external_periodic_tasks    = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] scst_target_driver             = iscsi {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] scst_target_iqn_name           = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_down_time              = 720 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] shell_completion               = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] snapshot_name_template         = snapshot-%s {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] snapshot_same_host             = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] split_loggers                  = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] state_path                     = /opt/stack/data/cinder {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] storage_availability_zone      = nova {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] storage_protocol               = iSCSI {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] syslog_log_facility            = LOG_USER {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] target_helper                  = lioadm {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] target_ip_address              = 192.168.122.51 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] target_port                    = 3260 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] target_protocol                = iscsi {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] target_secondary_ip_addresses  = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] trace_flags                    = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] transport_url                  = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] until_refresh                  = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] use_chap_auth                  = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] use_default_quota_class        = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] use_journal                    = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] use_json                       = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] use_multipath_for_image_xfer   = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] use_stderr                     = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] use_syslog                     = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] verify_glance_signatures       = enabled {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_api_class               = cinder.volume.api.API {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_backend_name            = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_clear                   = zero {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_clear_ionice            = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_clear_size              = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_copy_bps_limit          = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_dd_blocksize            = 1M {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_name_template           = volume-%s {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_service_inithost_offload = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volume_usage_audit_period      = month {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] zoning_mode                    = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_concurrency.disable_process_locking = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.admin_password = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.admin_token = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.admin_user  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.auth_protocol = https {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.auth_section = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.auth_type   = password {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.auth_uri    = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.auth_version = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.cache       = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.certfile    = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.identity_uri = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.include_service_catalog = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.insecure    = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.interface   = public {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.keyfile     = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_password =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcache_username =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.region_name = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.service_type = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.51/identity {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.backend                  = dogpile.cache.null {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.backend_argument         = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.backend_expiration_time  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.config_prefix            = cache.oslo {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.debug_cache_backend      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.enable_retry_client      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.enable_socket_keepalive  = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.enabled                  = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.enforce_fips_mode        = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.expiration_time          = 600 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.hashclient_retry_attempts = 2 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.memcache_dead_retry      = 300 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.memcache_sasl_enabled    = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.password                 = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.proxies                  = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.redis_db                 = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.redis_server             = localhost:6379 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.retry_attempts           = 2 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.retry_delay              = 0.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.socket_keepalive_count   = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.socket_keepalive_idle    = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.socket_keepalive_interval = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.socket_timeout           = 1.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.tls_allowed_ciphers      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.tls_cafile               = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.tls_certfile             = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.tls_enabled              = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.tls_keyfile              = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cache.username                 = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] coordination.backend_url       = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.asyncio_connection    = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.asyncio_slave_connection = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.backend               = sqlalchemy {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.connection            = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.connection_debug      = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.connection_parameters =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.connection_recycle_time = 3600 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.connection_trace      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.db_inc_retry_interval = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.db_max_retries        = 20 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.db_max_retry_interval = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.db_retry_interval     = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.max_overflow          = 50 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.max_pool_size         = 5 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.max_retries           = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.mysql_wsrep_sync_wait = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.pool_timeout          = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.retry_interval        = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.slave_connection      = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.sqlite_synchronous    = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.synchronous_reader    = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] database.use_db_reconnect      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.connection_string     = messaging:// {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.enabled               = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.es_doc_type           = notification {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.es_scroll_size        = 10000 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.es_scroll_time        = 2m {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.filter_error_trace    = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.hmac_keys             = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.sentinel_service_name = mymaster {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.socket_timeout        = 0.1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.trace_requests        = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler.trace_sqlalchemy      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler_jaeger.process_tags   = {} {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler_jaeger.service_name_prefix = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] profiler_otlp.service_name_prefix = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.enforce_new_defaults = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: WARNING oslo_config.cfg [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.enforce_scope      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.policy_default_rule = default {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] privsep_osbrick.group          = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] privsep_osbrick.helper_command = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] privsep_osbrick.user           = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_sys_admin.group         = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_sys_admin.helper_command = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] cinder_sys_admin.user          = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.auth_section      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.auth_type         = password {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.cafile            = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.certfile          = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.collect_timing    = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.insecure          = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.keyfile           = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.send_service_user_token = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.split_loggers     = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] service_user.timeout           = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.auth_section            = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.auth_type               = password {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.certfile                = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.collect_timing          = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.insecure                = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.keyfile                 = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.region_name             = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.split_loggers           = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] glance.timeout                 = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.backend_availability_zone = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack sudo[72386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack sudo[72386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.chap_password = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.chap_username =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.disk_geometry = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.driver_client_cert = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.driver_client_cert_key = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.driver_data_namespace = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.driver_use_ssl = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.extra_capabilities = {} {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.filter_function = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.goodness_function = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.iscsi_target_flags =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.iscsi_write_cache = on {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.iser_ip_address = 192.168.122.51 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.iser_port     = 3260 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.lvm_share_target = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.lvm_type      = auto {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.num_shell_tries = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.replication_device = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.report_discard_supported = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.reserved_percentage = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.target_helper = tgtadm {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.target_ip_address = 192.168.122.51 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.target_port   = 3260 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.target_protocol = iscsi {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.trace_flags   = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.unique_fqdn_network = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.use_chap_auth = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_backend_name = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_clear  = zero {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_clear_ionice = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_clear_size = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_reports.file_event_handler = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_reports.log_dir           = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.backend_host       = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.chap_password      = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.chap_username      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.disk_geometry      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.driver_client_cert = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.extra_capabilities = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.filter_function    = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.goodness_function  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.iser_helper        = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.iser_port          = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.lvm_type           = auto {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.replication_device = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.report_discard_supported = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.reserved_percentage = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.scst_target_driver = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.storage_protocol   = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.target_ip_address  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.target_port        = 3260 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.trace_flags        = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_clear       = zero {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] lvmdriver-1.volumes_dir        = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_notifications.driver = [] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_notifications.retry = -1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] key_manager.fixed_key          = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.barbican_api_version  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.barbican_endpoint     = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.barbican_endpoint_type = public {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.barbican_region_name  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.cafile                = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.certfile              = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.collect_timing        = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.insecure              = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.keyfile               = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.number_of_retries     = 60 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.retry_delay           = 1 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.send_service_user_token = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.split_loggers         = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.timeout               = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.verify_ssl            = True {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican.verify_ssl_path       = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.auth_section = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.auth_type = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.cafile   = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.certfile = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.collect_timing = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.insecure = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.keyfile  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.split_loggers = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] barbican_service_user.timeout  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.approle_role_id          = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.approle_secret_id        = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.kv_mountpoint            = secret {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.kv_path                  = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.kv_version               = 2 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.namespace                = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.root_token_id            = **** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.ssl_ca_crt_file          = None {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.timeout                  = 60.0 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.use_ssl                  = False {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:12:46 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] ******************************************************************************** {{(pid=72276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 23:12:46 devstack sudo[72386]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:46 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:46 devstack sudo[72390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:46 devstack sudo[72390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:47 devstack sudo[72390]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:47 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.493s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:47 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:12:47 devstack cinder-volume[72382]: INFO cinder.brick.local_dev.lvm [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 15 23:12:47 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:47 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:47 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:47 devstack sudo[72642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:12:47 devstack sudo[72642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:47 devstack sudo[72642]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:47 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:47 devstack cinder-volume[72382]: DEBUG cinder.brick.local_dev.lvm [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72382) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 15 23:12:47 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:48 devstack sudo[72876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:48 devstack sudo[72876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:49 devstack sudo[72876]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:49 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.050s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:49 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:49 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:49 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:49 devstack sudo[73074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:49 devstack sudo[73074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:49 devstack sudo[73074]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:49 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.563s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:49 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:49 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:49 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:49 devstack sudo[73081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 15 23:12:49 devstack sudo[73081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:50 devstack sudo[73081]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:50 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.472s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:50 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:50 devstack sudo[73084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:12:50 devstack sudo[73084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:50 devstack sudo[73084]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:50 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:50 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:50 devstack sudo[73089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:12:50 devstack sudo[73089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:51 devstack sudo[73089]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:51 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:51 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:51 devstack sudo[73093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:12:51 devstack sudo[73093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:51 devstack sudo[73093]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:51 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:51 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:51 devstack sudo[73100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:51 devstack sudo[73100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:51 devstack sudo[73100]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:51 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:51 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:51 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:51 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:52 devstack sudo[73104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:52 devstack sudo[73104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:52 devstack sudo[73104]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:52 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.484s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:52 devstack cinder-volume[72382]: INFO cinder.volume.drivers.lvm [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 15 23:12:52 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:52 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:52 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:52 devstack sudo[73199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:52 devstack sudo[73199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:52 devstack sudo[73199]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:52 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:52 devstack cinder-volume[72382]: DEBUG cinder.volume.drivers.lvm [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Updating volume stats {{(pid=72382) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 23:12:52 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:52 devstack sudo[73227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:12:52 devstack sudo[73227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:53 devstack sudo[73227]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:53 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:53 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:53 devstack sudo[73283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:12:53 devstack sudo[73283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:53 devstack sudo[73283]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:53 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:53 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:53 devstack sudo[73373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:53 devstack sudo[73373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:54 devstack sudo[73373]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:54 devstack sudo[73376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:12:54 devstack sudo[73376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:54 devstack sudo[73376]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:54 devstack cinder-volume[72382]: INFO cinder.volume.driver [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG cinder.volume.driver [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72382) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG oslo_db.sqlalchemy.engines [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72382) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG dbcounter [-] [72382] Writer thread running {{(pid=72382) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG cinder.db.sqlalchemy.api [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Building query based on filter {{(pid=72382) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG cinder.image.image_utils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72382) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 23:12:54 devstack cinder-volume[72382]: INFO cinder.keymgr.migration [None req-f5d27fc1-8298-48d2-827d-f54960b2930c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG cinder.volume.drivers.lvm [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Updating volume stats {{(pid=72382) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 23:12:54 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:54 devstack sudo[73381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:12:54 devstack sudo[73381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:55 devstack sudo[73381]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:55 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:55 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:55 devstack sudo[73385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:12:55 devstack sudo[73385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:55 devstack sudo[73385]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:55 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:55 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:55 devstack sudo[73391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:55 devstack sudo[73391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:56 devstack cinder-volume[72276]: DEBUG dbcounter [-] [72276] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:12:56 devstack sudo[73391]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:56 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:56 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:56 devstack sudo[73397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:12:56 devstack sudo[73397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:56 devstack sudo[73397]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:56 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.529s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:56 devstack cinder-volume[72382]: DEBUG cinder.manager [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Notifying Schedulers of capabilities ... {{(pid=72382) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:12:56 devstack cinder-volume[72382]: INFO cinder.volume.manager [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Driver initialization completed successfully.
Apr 15 23:12:56 devstack cinder-volume[72382]: INFO cinder.manager [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Initiating service 2 cleanup
Apr 15 23:12:56 devstack cinder-volume[72382]: INFO cinder.manager [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Service 2 cleanup completed.
Apr 15 23:12:56 devstack cinder-volume[72382]: DEBUG cinder.service [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Creating RPC server for service cinder-volume {{(pid=72382) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 23:12:56 devstack cinder-volume[72382]: DEBUG cinder.service [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72382) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 23:12:56 devstack cinder-volume[72382]: INFO cinder.volume.manager [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 15 23:12:56 devstack cinder-volume[72382]: DEBUG cinder.volume.drivers.lvm [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Updating volume stats {{(pid=72382) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 23:12:56 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:56 devstack sudo[73402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:12:56 devstack sudo[73402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:57 devstack sudo[73402]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:57 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:57 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:57 devstack sudo[73406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:12:57 devstack sudo[73406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:57 devstack sudo[73406]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:57 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:57 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:57 devstack sudo[73466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:12:57 devstack sudo[73466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:58 devstack sudo[73466]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:58 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:58 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:12:58 devstack sudo[73469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:12:58 devstack sudo[73469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:12:58 devstack sudo[73469]: pam_unix(sudo:session): session closed for user root
Apr 15 23:12:58 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:12:58 devstack cinder-volume[72382]: INFO cinder.volume.manager [None req-2a46f294-9001-4af0-80a2-0fb3de320b05 None None] Driver post RPC initialization completed successfully.
Apr 15 23:13:08 devstack cinder-volume[72382]: DEBUG dbcounter [-] [72382] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72382) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:13:08 devstack cinder-volume[72382]: DEBUG dbcounter [-] [72382] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72382) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:14:14 devstack cinder-volume[72382]: DEBUG oslo_service.periodic_task [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72382) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:14:14 devstack cinder-volume[72382]: DEBUG cinder.volume.drivers.lvm [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Updating volume stats {{(pid=72382) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 23:14:14 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:14:14 devstack sudo[78249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:14:14 devstack sudo[78249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:14:15 devstack sudo[78249]: pam_unix(sudo:session): session closed for user root
Apr 15 23:14:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:14:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:14:15 devstack sudo[78262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:14:15 devstack sudo[78262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:14:15 devstack sudo[78262]: pam_unix(sudo:session): session closed for user root
Apr 15 23:14:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:14:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:14:15 devstack sudo[78266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:14:15 devstack sudo[78266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:14:16 devstack sudo[78266]: pam_unix(sudo:session): session closed for user root
Apr 15 23:14:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:14:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:14:16 devstack sudo[78270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:14:16 devstack sudo[78270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:14:16 devstack sudo[78270]: pam_unix(sudo:session): session closed for user root
Apr 15 23:14:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:14:16 devstack cinder-volume[72382]: DEBUG cinder.manager [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Notifying Schedulers of capabilities ... {{(pid=72382) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:15:08 devstack cinder-volume[72382]: DEBUG dbcounter [-] [72382] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72382) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:15:14 devstack cinder-volume[72382]: DEBUG oslo_service.periodic_task [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72382) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:15:14 devstack cinder-volume[72382]: DEBUG cinder.volume.drivers.lvm [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Updating volume stats {{(pid=72382) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 23:15:14 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:15:14 devstack sudo[80056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:15:14 devstack sudo[80056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:15:15 devstack sudo[80056]: pam_unix(sudo:session): session closed for user root
Apr 15 23:15:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:15:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:15:15 devstack sudo[80071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:15:15 devstack sudo[80071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:15:15 devstack sudo[80071]: pam_unix(sudo:session): session closed for user root
Apr 15 23:15:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:15:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:15:15 devstack sudo[80096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:15:15 devstack sudo[80096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:15:16 devstack sudo[80096]: pam_unix(sudo:session): session closed for user root
Apr 15 23:15:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:15:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:15:16 devstack sudo[80115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:15:16 devstack sudo[80115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:15:16 devstack sudo[80115]: pam_unix(sudo:session): session closed for user root
Apr 15 23:15:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:15:16 devstack cinder-volume[72382]: DEBUG cinder.manager [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Notifying Schedulers of capabilities ... {{(pid=72382) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:16:14 devstack cinder-volume[72382]: DEBUG oslo_service.periodic_task [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72382) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:16:14 devstack cinder-volume[72382]: DEBUG cinder.volume.drivers.lvm [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Updating volume stats {{(pid=72382) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 23:16:14 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:14 devstack sudo[81273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 23:16:14 devstack sudo[81273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:15 devstack sudo[81273]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:15 devstack sudo[81299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:16:15 devstack sudo[81299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:15 devstack sudo[81299]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:15 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:15 devstack sudo[81336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 23:16:15 devstack sudo[81336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:16 devstack sudo[81336]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:16 devstack sudo[81362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 23:16:16 devstack sudo[81362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:16 devstack sudo[81362]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:16 devstack cinder-volume[72382]: DEBUG oslo_concurrency.processutils [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72382) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:16 devstack cinder-volume[72382]: DEBUG cinder.manager [None req-d14c2917-0bc9-4f8a-a721-0107f0625718 None None] Notifying Schedulers of capabilities ... {{(pid=72382) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:16:17 devstack cinder-volume[72276]: INFO oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Caught SIGTERM, stopping children
Apr 15 23:16:17 devstack cinder-volume[72276]: DEBUG oslo_concurrency.lockutils [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Acquiring lock "singleton_lock" {{(pid=72276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 23:16:17 devstack cinder-volume[72276]: DEBUG oslo_concurrency.lockutils [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Acquired lock "singleton_lock" {{(pid=72276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 23:16:17 devstack cinder-volume[72276]: DEBUG oslo_concurrency.lockutils [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Releasing lock "singleton_lock" {{(pid=72276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 23:16:17 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Stop services. {{(pid=72276) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 23:16:17 devstack cinder-volume[72276]: DEBUG oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Killing children. {{(pid=72276) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 23:16:17 devstack cinder-volume[72276]: INFO oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Waiting on 1 children to exit
Apr 15 23:16:21 devstack cinder-volume[72382]: DEBUG oslo_concurrency.lockutils [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Acquiring lock "singleton_lock" {{(pid=72382) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 23:16:21 devstack cinder-volume[72382]: DEBUG oslo_concurrency.lockutils [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Acquired lock "singleton_lock" {{(pid=72382) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 23:16:21 devstack cinder-volume[72382]: DEBUG oslo_concurrency.lockutils [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Releasing lock "singleton_lock" {{(pid=72382) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 23:16:21 devstack cinder-volume[72382]: WARNING amqp [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 23:16:21 devstack cinder-volume[72382]: WARNING amqp [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 23:16:21 devstack cinder-volume[72276]: INFO oslo_service.backend._eventlet.service [None req-1dbb81c0-0d2e-451e-aba3-57efb8fd2055 None None] Child 72382 exited with status 0
Apr 15 23:16:22 devstack cinder-volume[81444]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 23:16:22 devstack cinder-volume[81444]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 23:16:22 devstack cinder-volume[81444]: we strongly recommend against using it for new projects.
Apr 15 23:16:22 devstack cinder-volume[81444]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 23:16:22 devstack cinder-volume[81444]: framework.  For more detail see
Apr 15 23:16:22 devstack cinder-volume[81444]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 23:16:22 devstack cinder-volume[81444]:   import eventlet  # noqa
Apr 15 23:16:24 devstack cinder-volume[81444]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81444) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 23:16:24 devstack cinder-volume[81444]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81444) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 23:16:24 devstack cinder-volume[81444]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81444) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 23:16:24 devstack cinder-volume[81444]: INFO dbcounter [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Registered counter for database cinder
Apr 15 23:16:24 devstack cinder-volume[81444]: DEBUG oslo_db.sqlalchemy.engines [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:16:24 devstack cinder-volume[81444]: DEBUG dbcounter [-] [81444] Writer thread running {{(pid=81444) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 23:16:24 devstack cinder-volume[81444]: INFO cinder.rpc [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 23:16:24 devstack cinder-volume[81444]: INFO cinder.rpc [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 23:16:24 devstack cinder-volume[81444]: DEBUG oslo_db.sqlalchemy.engines [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:16:24 devstack cinder-volume[81444]: INFO cinder.volume.manager [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Determined volume DB was empty at startup.
Apr 15 23:16:24 devstack cinder-volume[81444]: DEBUG cinder.volume.manager [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81444) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 23:16:24 devstack cinder-volume[81444]: INFO cinder.volume.manager [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 23:16:24 devstack cinder-volume[81444]: WARNING stevedore.named [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 23:16:24 devstack cinder-volume[81444]: WARNING castellan.key_manager [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 23:16:24 devstack cinder-volume[81444]: WARNING cinder.keymgr.conf_key_mgr [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 23:16:25 devstack cinder-volume[81444]: INFO cinder.volume.manager [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_db.sqlalchemy.engines [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:16:25 devstack cinder-volume[81444]: INFO oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Starting 1 workers
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Started child 81563 {{(pid=81444) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Full set of CONF: {{(pid=81444) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] ******************************************************************************** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Configuration options gathered from: {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] ================================================================================ {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] allow_availability_zone_fallback = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] allow_compression_on_image_upload = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] allowed_direct_url_schemes     = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] api_rate_limit                 = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] auth_strategy                  = keystone {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_availability_zone      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_host                   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_name                   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_stats_polling_interval = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backup_api_class               = cinder.backup.api.API {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backup_name_template           = backup-%s {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backup_use_same_host           = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backup_use_temp_snapshot       = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] chap_password                  = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] chap_username                  =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_internal_tenant_project_id = bf48bf5b8be8445bb83a530d1fa3219f {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_internal_tenant_user_id = b5b7b84b3c6042d6b4928a135a055478 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cluster                        = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] compression_format             = gzip {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] config_dir                     = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] config_source                  = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] control_exchange               = openstack {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] debug                          = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] default_availability_zone      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] default_group_type             = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] default_volume_type            = QuobyteHD {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] disk_geometry                  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] driver_client_cert             = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] driver_client_cert_key         = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] driver_data_namespace          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] driver_ssl_cert_path           = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] driver_ssl_cert_verify         = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] driver_use_ssl                 = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] enable_new_services            = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] enable_unsupported_driver      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] enforce_multipath_for_image_xfer = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] filter_function                = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_api_insecure            = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_api_servers             = ['http://192.168.122.51/image'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_api_ssl_compression     = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_ca_certificates_file    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_certfile                = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_keyfile                 = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_num_retries             = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance_request_timeout         = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] goodness_function              = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] graceful_shutdown_timeout      = 5 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] group_api_class                = cinder.group.api.API {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] host                           = devstack {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_compress_on_upload       = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_conversion_address_space_limit = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_conversion_cpu_limit     = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81563]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_conversion_disable       = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_upload_use_cinder_backend = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_upload_use_internal_tenant = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_volume_cache_enabled     = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_volume_cache_max_count   = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] image_volume_cache_max_size_gb = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] init_host_max_objects_retrieval = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] iscsi_target_flags             =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] iscsi_write_cache              = on {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] iser_helper                    = tgtadm {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] iser_ip_address                = 192.168.122.51 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] iser_port                      = 3260 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_color                      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_config_append              = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_dir                        = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_file                       = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_options                    = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_rotate_interval            = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_rotate_interval_type       = days {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] log_rotation_type              = none {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] max_age                        = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] max_logfile_count              = 30 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] max_logfile_size_mb            = 200 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] max_over_subscription_ratio    = 20.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] message_reap_interval          = 86400 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] message_ttl                    = 2592000 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] migration_create_volume_timeout_secs = 300 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] monkey_patch                   = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] monkey_patch_modules           = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] my_ip                          = 192.168.122.51 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] no_snapshot_gb_quota           = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] num_iser_scan_tries            = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] num_shell_tries                = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] num_volume_device_scan_tries   = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] nvmeof_conn_info_version       = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] nvmet_ns_id                    = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] nvmet_port_id                  = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] osapi_max_limit                = 1000 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] osapi_volume_ext_list          = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] osapi_volume_listen_port       = 8776 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] osapi_volume_use_ssl           = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] osapi_volume_workers           = 2 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] per_volume_size_limit          = -1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] periodic_fuzzy_delay           = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] periodic_interval              = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] public_endpoint                = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] publish_errors                 = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] quota_backup_gigabytes         = 1000 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] quota_backups                  = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] quota_gigabytes                = 1000 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] quota_groups                   = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] quota_snapshots                = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] quota_volumes                  = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] rate_limit_burst               = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] rate_limit_except_level        = CRITICAL {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] rate_limit_interval            = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] reinit_driver_count            = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] replication_device             = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] report_discard_supported       = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] report_interval                = 120 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] reservation_clean_interval     = 86400 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] reservation_expire             = 86400 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] reserved_image_namespaces      = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] reserved_percentage            = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] rpc_response_timeout           = 120 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] run_external_periodic_tasks    = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] scst_target_driver             = iscsi {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] scst_target_iqn_name           = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_down_time              = 720 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] shell_completion               = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] snapshot_name_template         = snapshot-%s {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] split_loggers                  = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] state_path                     = /opt/stack/data/cinder {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] storage_availability_zone      = nova {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] storage_protocol               = iSCSI {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] syslog_log_facility            = LOG_USER {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] target_helper                  = lioadm {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] target_ip_address              = 192.168.122.51 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] target_port                    = 3260 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] target_protocol                = iscsi {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] target_secondary_ip_addresses  = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] trace_flags                    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] transport_url                  = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] until_refresh                  = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] use_chap_auth                  = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] use_default_quota_class        = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] use_journal                    = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] use_json                       = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] use_multipath_for_image_xfer   = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] use_stderr                     = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] use_syslog                     = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] verify_glance_signatures       = enabled {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_api_class               = cinder.volume.api.API {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_backend_name            = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_clear                   = zero {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_clear_ionice            = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_clear_size              = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_copy_bps_limit          = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_dd_blocksize            = 1M {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_name_template           = volume-%s {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_service_inithost_offload = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volume_usage_audit_period      = month {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] zoning_mode                    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_concurrency.disable_process_locking = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.admin_password = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.admin_token = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.admin_user  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.auth_protocol = https {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.auth_section = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.auth_type   = password {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.auth_uri    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.auth_version = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.cache       = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.certfile    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.identity_uri = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.include_service_catalog = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.insecure    = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.interface   = public {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.keyfile     = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_password =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcache_username =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.region_name = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.service_type = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.51/identity {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.backend                  = dogpile.cache.null {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.backend_argument         = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.backend_expiration_time  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.config_prefix            = cache.oslo {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.debug_cache_backend      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.enable_retry_client      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.enable_socket_keepalive  = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.enabled                  = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.enforce_fips_mode        = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.expiration_time          = 600 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.hashclient_retry_attempts = 2 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.memcache_dead_retry      = 300 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.memcache_sasl_enabled    = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.password                 = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.proxies                  = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.redis_db                 = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.redis_server             = localhost:6379 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.retry_attempts           = 2 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.retry_delay              = 0.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.socket_keepalive_count   = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.socket_keepalive_idle    = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.socket_keepalive_interval = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.socket_timeout           = 1.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.tls_allowed_ciphers      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.tls_cafile               = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.tls_certfile             = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.tls_enabled              = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.tls_keyfile              = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cache.username                 = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] coordination.backend_url       = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.asyncio_connection    = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.asyncio_slave_connection = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.backend               = sqlalchemy {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.connection            = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.connection_debug      = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.connection_parameters =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.connection_recycle_time = 3600 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.connection_trace      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.db_inc_retry_interval = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.db_max_retries        = 20 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.db_max_retry_interval = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.db_retry_interval     = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.max_overflow          = 50 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.max_pool_size         = 5 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.max_retries           = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.mysql_wsrep_sync_wait = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.pool_timeout          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.retry_interval        = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.slave_connection      = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.sqlite_synchronous    = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.synchronous_reader    = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] database.use_db_reconnect      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.connection_string     = messaging:// {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.enabled               = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.es_doc_type           = notification {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.es_scroll_size        = 10000 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.es_scroll_time        = 2m {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.filter_error_trace    = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.hmac_keys             = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.sentinel_service_name = mymaster {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.socket_timeout        = 0.1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.trace_requests        = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler.trace_sqlalchemy      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler_jaeger.process_tags   = {} {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler_jaeger.service_name_prefix = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] profiler_otlp.service_name_prefix = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.enforce_new_defaults = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: WARNING oslo_config.cfg [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.enforce_scope      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.policy_default_rule = default {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] privsep_osbrick.group          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] privsep_osbrick.helper_command = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] privsep_osbrick.user           = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_sys_admin.group         = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_sys_admin.helper_command = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] cinder_sys_admin.user          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.auth_section      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.auth_type         = password {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.cafile            = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.certfile          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.collect_timing    = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.insecure          = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.keyfile           = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.send_service_user_token = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.split_loggers     = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] service_user.timeout           = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.auth_section            = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.auth_type               = password {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.certfile                = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.collect_timing          = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.insecure                = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.keyfile                 = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.region_name             = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.split_loggers           = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] glance.timeout                 = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.backend_availability_zone = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.chap_password = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.chap_username =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.disk_geometry = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.driver_client_cert = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.driver_client_cert_key = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.driver_data_namespace = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.driver_use_ssl = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.extra_capabilities = {} {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.filter_function = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.goodness_function = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.iscsi_target_flags =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.iscsi_write_cache = on {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.iser_ip_address = 192.168.122.51 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.iser_port     = 3260 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_host      =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_login     = admin {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_mount_options = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_password  = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_private_key =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_share_path =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.num_shell_tries = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.quobyte_volume_url = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.replication_device = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.report_discard_supported = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.reserved_percentage = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.target_helper = tgtadm {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.target_ip_address = 192.168.122.51 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.target_port   = 3260 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.target_protocol = iscsi {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.trace_flags   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.unique_fqdn_network = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.use_chap_auth = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volume_backend_name = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volume_clear  = zero {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volume_clear_ionice = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volume_clear_size = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_reports.file_event_handler = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_reports.log_dir           = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.backend_availability_zone = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.backend_host         = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.chap_password        = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.chap_username        = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.disk_geometry        = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.driver_client_cert   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.driver_data_namespace = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.extra_capabilities   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.filter_function      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.goodness_function    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.iser_helper          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.iser_ip_address      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.iser_port            = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_host             = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_login            = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_mount_options    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_password         = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_private_key      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_share_path       = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.num_shell_tries      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.replication_device   = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.report_discard_supported = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.reserved_percentage  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.scst_target_driver   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.storage_protocol     = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.target_helper        = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.target_ip_address    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.target_port          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.target_prefix        = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.target_protocol      = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.trace_flags          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.use_chap_auth        = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volume_clear         = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volume_clear_size    = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] QuobyteHD.volumes_dir          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_notifications.driver = [] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_notifications.retry = -1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] key_manager.fixed_key          = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81563]: INFO cinder.volume.manager [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.barbican_api_version  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.barbican_endpoint     = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.barbican_endpoint_type = public {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.barbican_region_name  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.cafile                = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.certfile              = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.collect_timing        = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.insecure              = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.keyfile               = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.number_of_retries     = 60 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.retry_delay           = 1 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.send_service_user_token = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.split_loggers         = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.timeout               = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.verify_ssl            = True {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican.verify_ssl_path       = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.auth_section = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.auth_type = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.cafile   = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.certfile = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.collect_timing = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.insecure = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.keyfile  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.split_loggers = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] barbican_service_user.timeout  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.approle_role_id          = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.approle_secret_id        = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.kv_mountpoint            = secret {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.kv_path                  = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.kv_version               = 2 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.namespace                = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.root_token_id            = **** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.ssl_ca_crt_file          = None {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.timeout                  = 60.0 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.use_ssl                  = False {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.remotefs [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81563) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:25 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] ******************************************************************************** {{(pid=81444) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81563) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 23:16:25 devstack cinder-volume[81563]: WARNING cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 23:16:25 devstack cinder-volume[81563]: WARNING cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Running cmd (subprocess): mount.quobyte {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:25 devstack quobyte-client[81565]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 23:16:25 devstack quobyte-client[81565]: Invalid parameters found, error: missing mount point.
Apr 15 23:16:25 devstack quobyte-client[81565]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 23:16:25 devstack quobyte-client[81565]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:16:25 devstack cinder-volume[81563]: INFO cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 ...
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac -c /etc/quobyte/client-cinder.cfg {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:25 devstack sudo[81566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac -c /etc/quobyte/client-cinder.cfg
Apr 15 23:16:25 devstack sudo[81566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:25 devstack sudo[81566]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.519s {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:25 devstack cinder-volume[81563]: INFO cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 succeeded
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.526s {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:16:25 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:25 devstack sudo[81635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:16:25 devstack sudo[81635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:26 devstack sudo[81635]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.381s {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:26 devstack cinder-volume[81563]: INFO cinder.volume.driver [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.volume.driver [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328147888184, 'free_capacity_gb': 1775.7328147888184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81563) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_db.sqlalchemy.engines [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG dbcounter [-] [81563] Writer thread running {{(pid=81563) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.db.sqlalchemy.api [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Building query based on filter {{(pid=81563) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.image.image_utils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81563) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 23:16:26 devstack cinder-volume[81563]: INFO cinder.keymgr.migration [None req-fcdfc0d1-98e2-4801-8359-c11f21821243 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:26 devstack sudo[81638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:16:26 devstack sudo[81638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:26 devstack sudo[81638]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.413s {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.manager [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Notifying Schedulers of capabilities ... {{(pid=81563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:16:26 devstack cinder-volume[81563]: INFO cinder.volume.manager [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Driver initialization completed successfully.
Apr 15 23:16:26 devstack cinder-volume[81563]: INFO cinder.manager [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Initiating service 3 cleanup
Apr 15 23:16:26 devstack cinder-volume[81563]: INFO cinder.manager [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Service 3 cleanup completed.
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.service [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Creating RPC server for service cinder-volume {{(pid=81563) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.service [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81563) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 23:16:26 devstack cinder-volume[81563]: INFO cinder.volume.manager [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:16:26 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:26 devstack sudo[81645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:16:26 devstack sudo[81645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:27 devstack sudo[81645]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:27 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.404s {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:27 devstack cinder-volume[81563]: INFO cinder.volume.manager [None req-a7c22bab-1757-4f2f-a28b-12cf6c830a67 None None] Driver post RPC initialization completed successfully.
Apr 15 23:16:30 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-6412a1c8-085a-4b7b-8567-2254410676ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:16:30 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-6412a1c8-085a-4b7b-8567-2254410676ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:16:30 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-6412a1c8-085a-4b7b-8567-2254410676ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81563) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:16:30 devstack cinder-volume[81563]: DEBUG cinder.volume.drivers.quobyte [None req-6412a1c8-085a-4b7b-8567-2254410676ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81563) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:16:30 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-6412a1c8-085a-4b7b-8567-2254410676ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81563) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:16:30 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-6412a1c8-085a-4b7b-8567-2254410676ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:30 devstack sudo[81708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:16:30 devstack sudo[81708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:30 devstack sudo[81708]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:30 devstack cinder-volume[81563]: DEBUG oslo_concurrency.processutils [None req-6412a1c8-085a-4b7b-8567-2254410676ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.380s {{(pid=81563) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:30 devstack cinder-volume[81563]: DEBUG cinder.manager [None req-6412a1c8-085a-4b7b-8567-2254410676ec None None] Notifying Schedulers of capabilities ... {{(pid=81563) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:16:33 devstack cinder-volume[81444]: INFO oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Caught SIGTERM, stopping children
Apr 15 23:16:33 devstack cinder-volume[81444]: DEBUG oslo_concurrency.lockutils [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Acquiring lock "singleton_lock" {{(pid=81444) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 23:16:33 devstack cinder-volume[81444]: DEBUG oslo_concurrency.lockutils [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Acquired lock "singleton_lock" {{(pid=81444) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 23:16:33 devstack cinder-volume[81444]: DEBUG oslo_concurrency.lockutils [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Releasing lock "singleton_lock" {{(pid=81444) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 23:16:33 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Stop services. {{(pid=81444) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 23:16:33 devstack cinder-volume[81444]: DEBUG oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Killing children. {{(pid=81444) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 23:16:33 devstack cinder-volume[81444]: INFO oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Waiting on 1 children to exit
Apr 15 23:16:35 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Acquiring lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 23:16:35 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Acquired lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 23:16:35 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Releasing lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 23:16:35 devstack cinder-volume[81563]: WARNING amqp [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 23:16:35 devstack cinder-volume[81563]: WARNING amqp [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 23:16:35 devstack cinder-volume[81444]: INFO oslo_service.backend._eventlet.service [None req-8ab6fa24-14c0-4cd9-855b-212c3e393587 None None] Child 81563 exited with status 0
Apr 15 23:16:35 devstack cinder-volume[81788]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 23:16:35 devstack cinder-volume[81788]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 23:16:35 devstack cinder-volume[81788]: we strongly recommend against using it for new projects.
Apr 15 23:16:35 devstack cinder-volume[81788]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 23:16:35 devstack cinder-volume[81788]: framework.  For more detail see
Apr 15 23:16:35 devstack cinder-volume[81788]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 23:16:35 devstack cinder-volume[81788]:   import eventlet  # noqa
Apr 15 23:16:36 devstack cinder-volume[81788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 23:16:36 devstack cinder-volume[81788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 23:16:36 devstack cinder-volume[81788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 23:16:37 devstack cinder-volume[81788]: INFO dbcounter [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Registered counter for database cinder
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_db.sqlalchemy.engines [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81788) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG dbcounter [-] [81788] Writer thread running {{(pid=81788) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 23:16:37 devstack cinder-volume[81788]: INFO cinder.rpc [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 23:16:37 devstack cinder-volume[81788]: INFO cinder.rpc [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_db.sqlalchemy.engines [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81788) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:16:37 devstack cinder-volume[81788]: INFO cinder.volume.manager [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Determined volume DB was empty at startup.
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG cinder.volume.manager [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81788) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 23:16:37 devstack cinder-volume[81788]: WARNING stevedore.named [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 23:16:37 devstack cinder-volume[81788]: WARNING castellan.key_manager [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 23:16:37 devstack cinder-volume[81788]: WARNING cinder.keymgr.conf_key_mgr [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 23:16:37 devstack cinder-volume[81788]: INFO cinder.volume.manager [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_db.sqlalchemy.engines [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81788) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:16:37 devstack cinder-volume[81788]: INFO oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Starting 1 workers
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Started child 81941 {{(pid=81788) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Full set of CONF: {{(pid=81788) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] ******************************************************************************** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Configuration options gathered from: {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] ================================================================================ {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] allow_availability_zone_fallback = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] allow_compression_on_image_upload = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] allowed_direct_url_schemes     = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] api_rate_limit                 = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] auth_strategy                  = keystone {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_availability_zone      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_host                   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_name                   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_stats_polling_interval = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81941]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backup_api_class               = cinder.backup.api.API {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backup_name_template           = backup-%s {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backup_use_same_host           = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backup_use_temp_snapshot       = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] chap_password                  = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] chap_username                  =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_internal_tenant_project_id = bf48bf5b8be8445bb83a530d1fa3219f {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_internal_tenant_user_id = b5b7b84b3c6042d6b4928a135a055478 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cluster                        = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] compression_format             = gzip {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] config_dir                     = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] config_source                  = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] control_exchange               = openstack {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] debug                          = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] default_availability_zone      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] default_group_type             = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] default_volume_type            = QuobyteHD {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] disk_geometry                  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] driver_client_cert             = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] driver_client_cert_key         = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] driver_data_namespace          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] driver_ssl_cert_path           = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] driver_ssl_cert_verify         = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] driver_use_ssl                 = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] enable_new_services            = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] enable_unsupported_driver      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] enforce_multipath_for_image_xfer = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] filter_function                = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_api_insecure            = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_api_servers             = ['http://192.168.122.51/image'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_api_ssl_compression     = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_ca_certificates_file    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_certfile                = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_keyfile                 = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_num_retries             = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance_request_timeout         = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] goodness_function              = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] graceful_shutdown_timeout      = 5 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] group_api_class                = cinder.group.api.API {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] host                           = devstack {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_compress_on_upload       = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_conversion_address_space_limit = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_conversion_cpu_limit     = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_conversion_disable       = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_upload_use_cinder_backend = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_upload_use_internal_tenant = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_volume_cache_enabled     = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_volume_cache_max_count   = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] image_volume_cache_max_size_gb = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] init_host_max_objects_retrieval = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] iscsi_target_flags             =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] iscsi_write_cache              = on {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] iser_helper                    = tgtadm {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] iser_ip_address                = 192.168.122.51 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] iser_port                      = 3260 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_color                      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_config_append              = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_dir                        = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_file                       = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_options                    = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_rotate_interval            = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_rotate_interval_type       = days {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] log_rotation_type              = none {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] max_age                        = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] max_logfile_count              = 30 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] max_logfile_size_mb            = 200 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] max_over_subscription_ratio    = 20.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] message_reap_interval          = 86400 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] message_ttl                    = 2592000 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] migration_create_volume_timeout_secs = 300 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] monkey_patch                   = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] monkey_patch_modules           = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] my_ip                          = 192.168.122.51 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-71523648-b08f-441e-acca-8e821417d022 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] no_snapshot_gb_quota           = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] num_iser_scan_tries            = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-71523648-b08f-441e-acca-8e821417d022 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81941) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] num_shell_tries                = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] num_volume_device_scan_tries   = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:37 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] nvmeof_conn_info_version       = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] nvmet_ns_id                    = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] nvmet_port_id                  = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] osapi_max_limit                = 1000 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] osapi_volume_ext_list          = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] osapi_volume_listen_port       = 8776 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] osapi_volume_use_ssl           = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] osapi_volume_workers           = 2 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] per_volume_size_limit          = -1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] periodic_fuzzy_delay           = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] periodic_interval              = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] public_endpoint                = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] publish_errors                 = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] quota_backup_gigabytes         = 1000 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] quota_backups                  = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] quota_gigabytes                = 1000 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] quota_groups                   = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] quota_snapshots                = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] quota_volumes                  = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] rate_limit_burst               = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] rate_limit_except_level        = CRITICAL {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] rate_limit_interval            = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] reinit_driver_count            = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] replication_device             = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] report_discard_supported       = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] report_interval                = 120 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] reservation_clean_interval     = 86400 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] reservation_expire             = 86400 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] reserved_image_namespaces      = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] reserved_percentage            = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] rpc_response_timeout           = 120 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] run_external_periodic_tasks    = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] scst_target_driver             = iscsi {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] scst_target_iqn_name           = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_down_time              = 720 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] shell_completion               = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] snapshot_name_template         = snapshot-%s {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] split_loggers                  = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] state_path                     = /opt/stack/data/cinder {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] storage_availability_zone      = nova {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] storage_protocol               = iSCSI {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] syslog_log_facility            = LOG_USER {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] target_helper                  = lioadm {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] target_ip_address              = 192.168.122.51 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] target_port                    = 3260 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] target_protocol                = iscsi {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] target_secondary_ip_addresses  = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] trace_flags                    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] transport_url                  = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] until_refresh                  = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] use_chap_auth                  = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] use_default_quota_class        = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] use_journal                    = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] use_json                       = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] use_multipath_for_image_xfer   = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] use_stderr                     = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] use_syslog                     = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] verify_glance_signatures       = enabled {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_api_class               = cinder.volume.api.API {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_backend_name            = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_clear                   = zero {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_clear_ionice            = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_clear_size              = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_copy_bps_limit          = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_dd_blocksize            = 1M {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_name_template           = volume-%s {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_service_inithost_offload = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volume_usage_audit_period      = month {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] zoning_mode                    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_concurrency.disable_process_locking = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.admin_password = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.admin_token = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.admin_user  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.auth_protocol = https {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.auth_section = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.auth_type   = password {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.auth_uri    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.auth_version = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.cache       = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.certfile    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.identity_uri = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.include_service_catalog = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.insecure    = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.interface   = public {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.keyfile     = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_password =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcache_username =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.region_name = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.service_type = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.51/identity {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.backend                  = dogpile.cache.null {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.backend_argument         = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.backend_expiration_time  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.config_prefix            = cache.oslo {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.debug_cache_backend      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.enable_retry_client      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.enable_socket_keepalive  = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.enabled                  = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.enforce_fips_mode        = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.expiration_time          = 600 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.hashclient_retry_attempts = 2 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.memcache_dead_retry      = 300 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.memcache_sasl_enabled    = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.password                 = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.proxies                  = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.redis_db                 = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.redis_server             = localhost:6379 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.retry_attempts           = 2 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.retry_delay              = 0.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.socket_keepalive_count   = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.socket_keepalive_idle    = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.socket_keepalive_interval = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.socket_timeout           = 1.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.tls_allowed_ciphers      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.tls_cafile               = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.tls_certfile             = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.tls_enabled              = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.tls_keyfile              = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cache.username                 = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] coordination.backend_url       = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.asyncio_connection    = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.asyncio_slave_connection = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.backend               = sqlalchemy {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.connection            = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.connection_debug      = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.connection_parameters =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.connection_recycle_time = 3600 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81941) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.connection_trace      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.db_inc_retry_interval = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.db_max_retries        = 20 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.db_max_retry_interval = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.db_retry_interval     = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Running cmd (subprocess): mount.quobyte {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.max_overflow          = 50 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.max_pool_size         = 5 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.max_retries           = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.mysql_wsrep_sync_wait = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.pool_timeout          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.retry_interval        = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.slave_connection      = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.sqlite_synchronous    = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.synchronous_reader    = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] database.use_db_reconnect      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.connection_string     = messaging:// {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.enabled               = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.es_doc_type           = notification {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.es_scroll_size        = 10000 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.es_scroll_time        = 2m {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.filter_error_trace    = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.hmac_keys             = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.sentinel_service_name = mymaster {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.socket_timeout        = 0.1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.trace_requests        = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler.trace_sqlalchemy      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler_jaeger.process_tags   = {} {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler_jaeger.service_name_prefix = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] profiler_otlp.service_name_prefix = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.enforce_new_defaults = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: WARNING oslo_config.cfg [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.enforce_scope      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.policy_default_rule = default {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] privsep_osbrick.group          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] privsep_osbrick.helper_command = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] privsep_osbrick.user           = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_sys_admin.group         = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_sys_admin.helper_command = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] cinder_sys_admin.user          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.auth_section      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.auth_type         = password {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.cafile            = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.certfile          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.collect_timing    = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.insecure          = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.keyfile           = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.send_service_user_token = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.split_loggers     = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] service_user.timeout           = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.auth_section            = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.auth_type               = password {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.certfile                = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.collect_timing          = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.insecure                = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.keyfile                 = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.region_name             = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.split_loggers           = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] glance.timeout                 = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.backend_availability_zone = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.chap_password = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.chap_username =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.disk_geometry = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.driver_client_cert = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.driver_client_cert_key = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.driver_data_namespace = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.driver_use_ssl = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.extra_capabilities = {} {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.filter_function = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.goodness_function = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.iscsi_target_flags =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.iscsi_write_cache = on {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.iser_ip_address = 192.168.122.51 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.iser_port     = 3260 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_host      =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_login     = admin {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_mount_options = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_password  = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_private_key =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_share_path =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.num_shell_tries = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.quobyte_volume_url = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.replication_device = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.report_discard_supported = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.reserved_percentage = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.target_helper = tgtadm {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.target_ip_address = 192.168.122.51 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.target_port   = 3260 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.target_protocol = iscsi {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.trace_flags   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.unique_fqdn_network = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.use_chap_auth = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volume_backend_name = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volume_clear  = zero {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volume_clear_ionice = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volume_clear_size = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_reports.file_event_handler = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_reports.log_dir           = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.backend_availability_zone = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.backend_host         = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack quobyte-client[81964]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 23:16:38 devstack quobyte-client[81964]: Invalid parameters found, error: missing mount point.
Apr 15 23:16:38 devstack quobyte-client[81964]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 23:16:38 devstack quobyte-client[81964]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.chap_password        = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.chap_username        = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.disk_geometry        = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.driver_client_cert   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.driver_data_namespace = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.extra_capabilities   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.filter_function      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.goodness_function    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.iser_helper          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.iser_ip_address      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.iser_port            = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_host             = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_login            = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_mount_options    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_password         = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_private_key      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_share_path       = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.num_shell_tries      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.replication_device   = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.report_discard_supported = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.reserved_percentage  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.scst_target_driver   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.storage_protocol     = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.target_helper        = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.target_ip_address    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.target_port          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.target_prefix        = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.target_protocol      = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.trace_flags          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.use_chap_auth        = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volume_clear         = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volume_clear_size    = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] QuobyteHD.volumes_dir          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_notifications.driver = [] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_notifications.retry = -1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] key_manager.fixed_key          = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.barbican_api_version  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.barbican_endpoint     = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.barbican_endpoint_type = public {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.barbican_region_name  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.cafile                = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.certfile              = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.collect_timing        = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.insecure              = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.keyfile               = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.number_of_retries     = 60 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.retry_delay           = 1 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.send_service_user_token = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.split_loggers         = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.timeout               = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.verify_ssl            = True {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican.verify_ssl_path       = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.auth_section = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.auth_type = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.cafile   = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.certfile = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.collect_timing = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.insecure = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.keyfile  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.split_loggers = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] barbican_service_user.timeout  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.approle_role_id          = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.approle_secret_id        = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.kv_mountpoint            = secret {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.kv_path                  = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.kv_version               = 2 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.namespace                = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.root_token_id            = **** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.ssl_ca_crt_file          = None {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.timeout                  = 60.0 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.use_ssl                  = False {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 23:16:38 devstack cinder-volume[81788]: DEBUG oslo_service.backend._eventlet.service [None req-0034ae94-1b8a-4bbc-b04d-6e676fc3d691 None None] ******************************************************************************** {{(pid=81788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 23:16:38 devstack sudo[81966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:16:38 devstack sudo[81966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:39 devstack sudo[81966]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.935s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:39 devstack cinder-volume[81941]: INFO cinder.volume.driver [None req-71523648-b08f-441e-acca-8e821417d022 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.volume.driver [None req-71523648-b08f-441e-acca-8e821417d022 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328147888184, 'free_capacity_gb': 1775.7328147888184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81941) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_db.sqlalchemy.engines [None req-71523648-b08f-441e-acca-8e821417d022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writer thread running {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.db.sqlalchemy.api [None req-71523648-b08f-441e-acca-8e821417d022 None None] Building query based on filter {{(pid=81941) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81941) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:39 devstack cinder-volume[81941]: INFO cinder.keymgr.migration [None req-263a9cea-dd90-4526-a353-9b9b45ff4c18 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 23:16:39 devstack sudo[82029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:16:39 devstack sudo[82029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:39 devstack sudo[82029]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-71523648-b08f-441e-acca-8e821417d022 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:16:39 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-71523648-b08f-441e-acca-8e821417d022 None None] Driver initialization completed successfully.
Apr 15 23:16:39 devstack cinder-volume[81941]: INFO cinder.manager [None req-71523648-b08f-441e-acca-8e821417d022 None None] Initiating service 3 cleanup
Apr 15 23:16:39 devstack cinder-volume[81941]: INFO cinder.manager [None req-71523648-b08f-441e-acca-8e821417d022 None None] Service 3 cleanup completed.
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.service [None req-71523648-b08f-441e-acca-8e821417d022 None None] Creating RPC server for service cinder-volume {{(pid=81941) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.service [None req-71523648-b08f-441e-acca-8e821417d022 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81941) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 23:16:39 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-71523648-b08f-441e-acca-8e821417d022 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-71523648-b08f-441e-acca-8e821417d022 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:16:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:16:39 devstack sudo[82035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:16:39 devstack sudo[82035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:16:40 devstack sudo[82035]: pam_unix(sudo:session): session closed for user root
Apr 15 23:16:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-71523648-b08f-441e-acca-8e821417d022 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.444s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:16:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-71523648-b08f-441e-acca-8e821417d022 None None] Driver post RPC initialization completed successfully.
Apr 15 23:16:47 devstack cinder-volume[81788]: DEBUG dbcounter [-] [81788] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81788) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:16:49 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:16:50 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=3 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:16:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2794c4bd-810b-48a5-8f0f-32dc77791887 tempest-BackendsCapabilitiesAdminTestsJSON-1765029729 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328147888184, 'free_capacity_gb': 1775.7328147888184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81941) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 23:16:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-760438a0-cf51-4abc-b0f9-23749b835d94 tempest-BackendsCapabilitiesAdminTestsJSON-1765029729 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328147888184, 'free_capacity_gb': 1775.7328147888184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81941) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 23:17:39 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ec29747d-d4b3-4949-a4f2-79fb5a99e894 tempest-GroupsV314Test-306338191 None] Group tempest-GroupsV314Test-Group-377892540: creating
Apr 15 23:17:39 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:17:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Flow 'volume_create_manager' (3b986757-bab3-45bf-aa75-85bbbe08186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae28be4-32bc-4851-8e04-e2e2bf9218d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae28be4-32bc-4851-8e04-e2e2bf9218d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1082274839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70abec5a-489f-4f4c-bf8d-449209f72bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6a3ef998644cf7a631e5e08d3e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:40Z,use_quota=True,user_id='133eb5debf604c70b6a5eab10192ed5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ea5c7b-367c-4d1b-8555-04926e5a482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ea5c7b-367c-4d1b-8555-04926e5a482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64676dbe-e50f-4ef3-baa3-8878ba02883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64676dbe-e50f-4ef3-baa3-8878ba02883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70abec5a-489f-4f4c-bf8d-449209f72bdf', 'volume_name': 'volume-70abec5a-489f-4f4c-bf8d-449209f72bdf', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89250feb-d50d-47fd-9aa8-f6f7f3e203f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89250feb-d50d-47fd-9aa8-f6f7f3e203f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e89f0c-6f5e-4de6-bde2-fe11538bc032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Volume 70abec5a-489f-4f4c-bf8d-449209f72bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70abec5a-489f-4f4c-bf8d-449209f72bdf', 'volume_size': 1}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1082274839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70abec5a-489f-4f4c-bf8d-449209f72bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6a3ef998644cf7a631e5e08d3e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:40Z,use_quota=True,user_id='133eb5debf604c70b6a5eab10192ed5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Creating volume 70abec5a-489f-4f4c-bf8d-449209f72bdf {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:17:40 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ec29747d-d4b3-4949-a4f2-79fb5a99e894 tempest-GroupsV314Test-306338191 None] Group tempest-GroupsV314Test-Group-377892540: created successfully
Apr 15 23:17:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ec29747d-d4b3-4949-a4f2-79fb5a99e894 tempest-GroupsV314Test-306338191 None] Create group completed successfully.
Apr 15 23:17:40 devstack sudo[82361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf 1073741824
Apr 15 23:17:40 devstack sudo[82361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Flow 'volume_create_manager' (8347d741-007b-4354-bfed-8675a15a9ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a802ef2-dc15-49de-b2c5-22d1a321336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a802ef2-dc15-49de-b2c5-22d1a321336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1490838428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70b6622c638f468a94d0215a60082b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:40Z,use_quota=True,user_id='92a96520900c4c54b34bb1db6b82e9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee680492-9527-4a07-bc3e-62c23fdbccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee680492-9527-4a07-bc3e-62c23fdbccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7235e50a-db1c-44a8-b762-b64c6d3bada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7235e50a-db1c-44a8-b762-b64c6d3bada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c', 'volume_name': 'volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f5231c-9262-4393-a715-2ad81c787922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f5231c-9262-4393-a715-2ad81c787922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc3dc9d-6849-4c6b-864f-1b8746646bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Volume 726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c', 'volume_size': 1}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Flow 'volume_create_manager' (2325b736-60d7-479f-a390-d79e7aac8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d20e42-70ca-4de1-8168-0f64ca246f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d20e42-70ca-4de1-8168-0f64ca246f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1944784127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7933dda8-a784-4cab-b8b3-b7e63b415b43,host='devstack@QuobyteHD#QuobyteHD',id=1276a9db-cd09-459e-8d28-d163ce565170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889af901010548fd9b52acda4da66270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:41Z,use_quota=True,user_id='9ac6050912d34675b7d9db47b17685de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f98a1a83-d196-4b2a-b8e1-65a2c717615e),volume_type_id=f98a1a83-d196-4b2a-b8e1-65a2c717615e)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa0e127-a375-4537-b5f4-92168256903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa0e127-a375-4537-b5f4-92168256903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb28088c-1902-4672-bb77-f15d49c5b7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb28088c-1902-4672-bb77-f15d49c5b7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1276a9db-cd09-459e-8d28-d163ce565170', 'volume_name': 'volume-1276a9db-cd09-459e-8d28-d163ce565170', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a47e599-6a3e-49d8-b37a-47ac1c104c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a47e599-6a3e-49d8-b37a-47ac1c104c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d919ba-bd03-4edc-846c-b36651c7a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Volume 1276a9db-cd09-459e-8d28-d163ce565170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1276a9db-cd09-459e-8d28-d163ce565170', 'volume_size': 1}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:41 devstack sudo[82361]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf 1073741824" returned: 0 in 0.983s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:41 devstack sudo[82721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf
Apr 15 23:17:41 devstack sudo[82721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:41 devstack sudo[82721]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf" returned: 0 in 0.411s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1490838428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70b6622c638f468a94d0215a60082b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:40Z,use_quota=True,user_id='92a96520900c4c54b34bb1db6b82e9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Creating volume 726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:17:41 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e89f0c-6f5e-4de6-bde2-fe11538bc032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70abec5a-489f-4f4c-bf8d-449209f72bdf', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450c0fa-41fe-4d25-89f1-1bc22c1caf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:41 devstack sudo[82730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c 1073741824
Apr 15 23:17:41 devstack sudo[82730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Volume volume-70abec5a-489f-4f4c-bf8d-449209f72bdf (70abec5a-489f-4f4c-bf8d-449209f72bdf): created successfully
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450c0fa-41fe-4d25-89f1-1bc22c1caf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Flow 'volume_create_manager' (3b986757-bab3-45bf-aa75-85bbbe08186a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-467a6a62-ec90-4df9-938b-a86cfe8f50c5 tempest-DeleteServersTestJSON-1475251688 None] Created volume successfully.
Apr 15 23:17:41 devstack sudo[82730]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c 1073741824" returned: 0 in 0.512s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:42 devstack sudo[82736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c
Apr 15 23:17:42 devstack sudo[82736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:42 devstack sudo[82736]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c" returned: 0 in 0.433s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7933dda8-a784-4cab-b8b3-b7e63b415b43,created_at=2026-04-15T21:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1944784127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7933dda8-a784-4cab-b8b3-b7e63b415b43,host='devstack@QuobyteHD#QuobyteHD',id=1276a9db-cd09-459e-8d28-d163ce565170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889af901010548fd9b52acda4da66270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:41Z,use_quota=True,user_id='9ac6050912d34675b7d9db47b17685de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f98a1a83-d196-4b2a-b8e1-65a2c717615e),volume_type_id=f98a1a83-d196-4b2a-b8e1-65a2c717615e)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Creating volume 1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:17:42 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc3dc9d-6849-4c6b-864f-1b8746646bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:42 devstack sudo[82747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 1073741824
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca44d253-e243-465d-a3ed-e136ea4bdd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:42 devstack sudo[82747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:42 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Volume volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c (726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c): created successfully
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca44d253-e243-465d-a3ed-e136ea4bdd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Flow 'volume_create_manager' (8347d741-007b-4354-bfed-8675a15a9ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:42 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-6879baca-1cdc-4e09-9ab9-da0c7dc74e00 req-d128c4a6-3b6a-4763-8de9-d882233ab5cf tempest-VolumesGetTestJSON-1955427253 None] Created volume successfully.
Apr 15 23:17:42 devstack sudo[82747]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 1073741824" returned: 0 in 0.482s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:42 devstack sudo[82754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170
Apr 15 23:17:42 devstack sudo[82754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Acquiring lock "cinder-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Lock "cinder-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Acquiring lock "cinder-quobyte-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Lock "cinder-quobyte-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:17:43 devstack cinder-volume[81941]: INFO oslo.privsep.daemon [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqixyzv5v/privsep.sock']
Apr 15 23:17:43 devstack sudo[82758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqixyzv5v/privsep.sock
Apr 15 23:17:43 devstack sudo[82758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:43 devstack sudo[82754]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d919ba-bd03-4edc-846c-b36651c7a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1276a9db-cd09-459e-8d28-d163ce565170', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1336c20-0edd-4eff-89de-30d0be85f29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:43 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Volume volume-1276a9db-cd09-459e-8d28-d163ce565170 (1276a9db-cd09-459e-8d28-d163ce565170): created successfully
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1336c20-0edd-4eff-89de-30d0be85f29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Flow 'volume_create_manager' (2325b736-60d7-479f-a390-d79e7aac8f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:43 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ad0a64f4-7293-48c6-9489-495f9dc8755d tempest-GroupsV314Test-306338191 None] Created volume successfully.
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 23:17:43 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 23:17:44 devstack cinder-volume[81941]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 15 23:17:44 devstack sudo[82758]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:44 devstack cinder-volume[81941]: INFO oslo.privsep.daemon [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Spawned new privsep daemon via rootwrap
Apr 15 23:17:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Accepted privsep connection to /tmp/tmpqixyzv5v/privsep.sock {{(pid=81941) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 15 23:17:44 devstack cinder-volume[81941]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 15 23:17:44 devstack cinder-volume[81941]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 15 23:17:44 devstack cinder-volume[81941]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 15 23:17:44 devstack cinder-volume[81941]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82763
Apr 15 23:17:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[342163e4-dd90-42da-9bb3-b3730ab3a4a9]: (2,) {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb8118d-5aec-40f7-884b-2365a358e355]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:44 devstack sudo[82766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c
Apr 15 23:17:44 devstack sudo[82766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:44 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Cloning volume 1276a9db-cd09-459e-8d28-d163ce565170 to volume 17235bcf-086d-4f94-a42f-b30eb6c32a7f
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Creating offline snapshot 707a4971-de83-44c4-a2da-08141b9353de of volume 1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:17:45 devstack sudo[82766]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c" returned: 0 in 0.575s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c7e5f9-edc4-46f4-ba9e-33e9ec86ab2c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:45 devstack sudo[82775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c
Apr 15 23:17:45 devstack sudo[82775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:45 devstack sudo[82776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170
Apr 15 23:17:45 devstack sudo[82776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:45 devstack sudo[82775]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c" returned: 0 in 0.620s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Lock "cinder-quobyte-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c" released by "delete_volume" :: held 2.302s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:17:45 devstack cinder-volume[81941]: WARNING cinder.quota [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:17:45 devstack cinder-volume[81941]: WARNING cinder.quota [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:17:45 devstack sudo[82776]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170" returned: 0 in 0.715s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG cinder.quota [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Created reservations ['c338090b-b82a-453d-852c-f477cdcae5f0', '3d034346-a207-4ca1-bfa2-d603f81438f0', 'bec4b269-1791-4f50-98dc-f026020e0ded', '3c1419d9-f3bf-4b82-8d51-470b2b537d00'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:17:45 devstack sudo[82790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de 1G
Apr 15 23:17:45 devstack sudo[82790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:45 devstack sudo[82793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:17:45 devstack sudo[82793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:46 devstack sudo[82793]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.564s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:46 devstack cinder-volume[81941]: DEBUG cinder.manager [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:17:46 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Deleted volume successfully.
Apr 15 23:17:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-1a16e264-fdc1-4860-ba93-857771020462 req-fdb67de9-2e81-49b4-ba43-4cb1e5407ad4 tempest-VolumesGetTestJSON-1955427253 None] Lock "cinder-726ff064-4bb6-48e3-bb4e-9d1ebe5aca6c-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:17:46 devstack sudo[82790]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de 1G" returned: 0 in 0.789s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1276a9db-cd09-459e-8d28-d163ce565170 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:46 devstack sudo[82802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1276a9db-cd09-459e-8d28-d163ce565170 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de
Apr 15 23:17:46 devstack sudo[82802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:47 devstack cinder-volume[81941]: WARNING py.warnings [req-1fd2d6bb-82d7-47c5-b0c6-61b80417cc8b req-bb9ce651-e98c-4da5-ab0f-4e5392a5a221 tempest-DeleteServersTestJSON-1475251688 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 15 23:17:47 devstack cinder-volume[81941]:   .first()
Apr 15 23:17:47 devstack cinder-volume[81941]: 
Apr 15 23:17:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-1fd2d6bb-82d7-47c5-b0c6-61b80417cc8b req-bb9ce651-e98c-4da5-ab0f-4e5392a5a221 tempest-DeleteServersTestJSON-1475251688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:47 devstack sudo[82802]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1276a9db-cd09-459e-8d28-d163ce565170 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de" returned: 0 in 0.602s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:47 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:17:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:47 devstack sudo[82825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de
Apr 15 23:17:47 devstack sudo[82825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:47 devstack sudo[82825]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de" returned: 0 in 0.484s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:47 devstack sudo[82840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.info
Apr 15 23:17:47 devstack sudo[82840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:48 devstack sudo[82840]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.info" returned: 0 in 0.461s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:48 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:48 devstack sudo[82843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.info
Apr 15 23:17:48 devstack sudo[82843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:48 devstack sudo[82843]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.info" returned: 0 in 0.523s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Acquiring lock "cinder-quobyte-17235bcf-086d-4f94-a42f-b30eb6c32a7f" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Lock "cinder-quobyte-17235bcf-086d-4f94-a42f-b30eb6c32a7f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] snapshot: 707a4971-de83-44c4-a2da-08141b9353de, volume: 17235bcf-086d-4f94-a42f-b30eb6c32a7f,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef4f057-9f65-48d0-9de7-e5fee0159569]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:48 devstack sudo[82847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de
Apr 15 23:17:48 devstack sudo[82847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:49 devstack sudo[82847]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de" returned: 0 in 0.513s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1276a9db-cd09-459e-8d28-d163ce565170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd77613b-72bb-47a8-ba61-485c246d19aa]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:49 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1094ef79-a429-46e5-a121-b0bc5aa244d1 tempest-GroupSnapshotsTest-17303575 None] Group tempest-GroupSnapshotsTest-Group-1770856612: creating
Apr 15 23:17:49 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1094ef79-a429-46e5-a121-b0bc5aa244d1 tempest-GroupSnapshotsTest-17303575 None] Group tempest-GroupSnapshotsTest-Group-1770856612: created successfully
Apr 15 23:17:49 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1094ef79-a429-46e5-a121-b0bc5aa244d1 tempest-GroupSnapshotsTest-17303575 None] Create group completed successfully.
Apr 15 23:17:49 devstack sudo[82853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170
Apr 15 23:17:49 devstack sudo[82853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:49 devstack sudo[82853]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170" returned: 0 in 0.547s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:17:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:49 devstack sudo[82859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f
Apr 15 23:17:49 devstack sudo[82859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Flow 'volume_create_manager' (13f4be5b-bac9-453b-9b74-d5badfd475a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f111cb2-1489-4d50-87ab-af018c36db4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f111cb2-1489-4d50-87ab-af018c36db4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-483595381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a365a2ea-604e-48a7-8336-77029ed865bb,host='devstack@QuobyteHD#QuobyteHD',id=5a1e58b3-a3a4-4e47-90d8-02d35aed3c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c66de2ca7d480a8c80be6e6684e145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:51Z,use_quota=True,user_id='69e09d35adc04c8daf822053b305d39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c93a0a8-516c-41c3-950f-15b76a7b94f8),volume_type_id=5c93a0a8-516c-41c3-950f-15b76a7b94f8)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace0d2ed-1045-4e25-8c3b-c37f1742f2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace0d2ed-1045-4e25-8c3b-c37f1742f2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e39633-515c-4801-b06e-ff9263577e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e39633-515c-4801-b06e-ff9263577e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a1e58b3-a3a4-4e47-90d8-02d35aed3c21', 'volume_name': 'volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb995f0a-536f-4a3f-8beb-9ba1e8a07b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb995f0a-536f-4a3f-8beb-9ba1e8a07b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c9586f-23e3-4c71-99c6-95e8301847fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:51 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Volume 5a1e58b3-a3a4-4e47-90d8-02d35aed3c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21', 'volume_size': 1}
Apr 15 23:17:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:52 devstack sudo[82859]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f" returned: 0 in 2.377s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:52 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba217c1-9b44-4f32-ab59-17f86364e9e7]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:52 devstack sudo[82897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170
Apr 15 23:17:52 devstack sudo[82897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:52 devstack sudo[82897]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170" returned: 0 in 0.754s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:52 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:17:52 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Converted 1024.00 MB image at 430.74 MB/s
Apr 15 23:17:52 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:17:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:52 devstack sudo[82933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f
Apr 15 23:17:52 devstack sudo[82933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:53 devstack sudo[82933]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f" returned: 0 in 0.431s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Lock "cinder-quobyte-17235bcf-086d-4f94-a42f-b30eb6c32a7f" released by "_copy_volume_from_snapshot" :: held 4.672s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Acquiring lock "cinder-quobyte-707a4971-de83-44c4-a2da-08141b9353de" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Lock "cinder-quobyte-707a4971-de83-44c4-a2da-08141b9353de" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Deleting offline snapshot 707a4971-de83-44c4-a2da-08141b9353de of volume 1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] snapshot_file for this snap is: volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c45bf4-8379-45df-a763-152b944fd028]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:53 devstack sudo[82938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de
Apr 15 23:17:53 devstack sudo[82938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:53 devstack sudo[82938]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de" returned: 0 in 0.530s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1276a9db-cd09-459e-8d28-d163ce565170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e153ba7-8703-4df4-9fd7-38b725df0106]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:53 devstack sudo[82945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170
Apr 15 23:17:53 devstack sudo[82945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:54 devstack sudo[82945]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170" returned: 0 in 0.474s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:54 devstack sudo[82952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de
Apr 15 23:17:54 devstack sudo[82952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:54 devstack sudo[82952]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de" returned: 0 in 0.504s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:54 devstack sudo[82959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de
Apr 15 23:17:54 devstack sudo[82959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Flow 'volume_create_manager' (accea0eb-3b26-4271-97a3-e68e4db65594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9043675a-1464-449f-a52c-2491f787ef4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9043675a-1464-449f-a52c-2491f787ef4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1168688348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6cbd82-4f5d-448a-81de-36a794e92929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8170b25d69524f068834e9af84825f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:55Z,use_quota=True,user_id='09be251905e644e6bda591e80a5f33b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed60e300-5e2e-466b-b666-fe5368b0df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed60e300-5e2e-466b-b666-fe5368b0df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227d6e2c-ecbf-449f-8faf-f1051e9d6385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227d6e2c-ecbf-449f-8faf-f1051e9d6385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6cbd82-4f5d-448a-81de-36a794e92929', 'volume_name': 'volume-3d6cbd82-4f5d-448a-81de-36a794e92929', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2563fbef-d536-40ef-820f-6703e794b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2563fbef-d536-40ef-820f-6703e794b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6516b9e-94e6-4de0-8264-00762edea0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:55 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Volume 3d6cbd82-4f5d-448a-81de-36a794e92929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6cbd82-4f5d-448a-81de-36a794e92929', 'volume_size': 1}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:55 devstack sudo[82959]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170.707a4971-de83-44c4-a2da-08141b9353de" returned: 0 in 0.554s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Lock "cinder-quobyte-707a4971-de83-44c4-a2da-08141b9353de" released by "_delete_snapshot" :: held 2.126s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.510s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-1fd2d6bb-82d7-47c5-b0c6-61b80417cc8b req-bb9ce651-e98c-4da5-ab0f-4e5392a5a221 tempest-DeleteServersTestJSON-1475251688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.442s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b49da55-bede-4cc4-af91-25f68e90a344]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-1fd2d6bb-82d7-47c5-b0c6-61b80417cc8b req-bb9ce651-e98c-4da5-ab0f-4e5392a5a221 tempest-DeleteServersTestJSON-1475251688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-fea5f31c-e26d-4000-843b-78c6ed7f6763 tempest-GroupsV314Test-306338191 None] Create group from source-group-7933dda8-a784-4cab-b8b3-b7e63b415b43 completed successfully.
Apr 15 23:17:55 devstack sudo[82963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf
Apr 15 23:17:55 devstack sudo[82963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:55 devstack sudo[82963]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-1fd2d6bb-82d7-47c5-b0c6-61b80417cc8b req-bb9ce651-e98c-4da5-ab0f-4e5392a5a221 tempest-DeleteServersTestJSON-1475251688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf" returned: 0 in 0.466s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-1fd2d6bb-82d7-47c5-b0c6-61b80417cc8b req-bb9ce651-e98c-4da5-ab0f-4e5392a5a221 tempest-DeleteServersTestJSON-1475251688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.477s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.713s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a365a2ea-604e-48a7-8336-77029ed865bb,created_at=2026-04-15T21:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-483595381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a365a2ea-604e-48a7-8336-77029ed865bb,host='devstack@QuobyteHD#QuobyteHD',id=5a1e58b3-a3a4-4e47-90d8-02d35aed3c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c66de2ca7d480a8c80be6e6684e145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:51Z,use_quota=True,user_id='69e09d35adc04c8daf822053b305d39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c93a0a8-516c-41c3-950f-15b76a7b94f8),volume_type_id=5c93a0a8-516c-41c3-950f-15b76a7b94f8)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Creating volume 5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:17:55 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:17:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:55 devstack sudo[82968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 1073741824
Apr 15 23:17:55 devstack sudo[82968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-1fd2d6bb-82d7-47c5-b0c6-61b80417cc8b req-bb9ce651-e98c-4da5-ab0f-4e5392a5a221 tempest-DeleteServersTestJSON-1475251688 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31', 'name': 'volume-70abec5a-489f-4f4c-bf8d-449209f72bdf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb1b819b-bc22-4ebf-871f-7b0820bf0e27', 'enforce_multipath': True} {{(pid=81941) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 23:17:56 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-1fd2d6bb-82d7-47c5-b0c6-61b80417cc8b req-bb9ce651-e98c-4da5-ab0f-4e5392a5a221 tempest-DeleteServersTestJSON-1475251688 None] attachment_update completed successfully.
Apr 15 23:17:56 devstack sudo[82968]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 1073741824" returned: 0 in 0.481s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:56 devstack sudo[82973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21
Apr 15 23:17:56 devstack sudo[82973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Acquiring lock "cinder-quobyte-17235bcf-086d-4f94-a42f-b30eb6c32a7f" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:17:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Lock "cinder-quobyte-17235bcf-086d-4f94-a42f-b30eb6c32a7f" acquired by "delete_volume" :: waited 0.018s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:17:56 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9ecc6-8fb0-4a1f-aabd-d0906178482a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:56 devstack sudo[83024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f
Apr 15 23:17:56 devstack sudo[83024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:57 devstack sudo[82973]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" returned: 0 in 0.535s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.654s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1168688348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6cbd82-4f5d-448a-81de-36a794e92929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8170b25d69524f068834e9af84825f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:55Z,use_quota=True,user_id='09be251905e644e6bda591e80a5f33b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Creating volume 3d6cbd82-4f5d-448a-81de-36a794e92929 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:17:57 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c9586f-23e3-4c71-99c6-95e8301847fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:57 devstack sudo[83047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929 1073741824
Apr 15 23:17:57 devstack sudo[83047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c9b67c-b52a-43e9-a807-51f062be5b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:57 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Volume volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 (5a1e58b3-a3a4-4e47-90d8-02d35aed3c21): created successfully
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c9b67c-b52a-43e9-a807-51f062be5b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Flow 'volume_create_manager' (13f4be5b-bac9-453b-9b74-d5badfd475a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-22915426-e16a-474a-b4ec-265bca4faf7b tempest-GroupSnapshotsTest-17303575 None] Created volume successfully.
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:57 devstack sudo[83049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:17:57 devstack sudo[83049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:57 devstack sudo[83024]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f" returned: 0 in 0.536s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:57 devstack sudo[83057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f
Apr 15 23:17:57 devstack sudo[83057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:57 devstack sudo[83047]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929 1073741824" returned: 0 in 0.516s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:57 devstack sudo[83376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929
Apr 15 23:17:57 devstack sudo[83376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] GroupSnapshot ac600ff2-0773-4747-bce8-e59249e4e84c: creating.
Apr 15 23:17:57 devstack sudo[83049]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.766s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Group snapshot ac600ff2-0773-4747-bce8-e59249e4e84c: creating. {{(pid=81941) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:58 devstack sudo[83057]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-17235bcf-086d-4f94-a42f-b30eb6c32a7f" returned: 0 in 0.635s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Lock "cinder-quobyte-17235bcf-086d-4f94-a42f-b30eb6c32a7f" released by "delete_volume" :: held 1.244s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Created reservations ['f5aa923b-ff39-4e66-8232-cc2c685d0084'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:17:58 devstack cinder-volume[81941]: WARNING cinder.quota [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1763106823 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1763106823, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:17:58 devstack cinder-volume[81941]: WARNING cinder.quota [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1763106823 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1763106823, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Created reservations ['bb9dcdb2-f95c-4f2b-8c0f-91f7e6b5c660', '5207f298-b107-47c9-b984-a0e34d9044f7', '04e7b81c-eda5-47c7-a577-5a4ce23c97ff', '7ca13df1-bf45-4aa0-9045-4638bfa65877'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:58 devstack sudo[83381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:17:58 devstack sudo[83381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:58 devstack sudo[83376]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929" returned: 0 in 0.760s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.310s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Creating offline snapshot 7acd728e-599a-45ed-a839-42f68d1a7465 of volume 5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6516b9e-94e6-4de0-8264-00762edea0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6cbd82-4f5d-448a-81de-36a794e92929', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a91d860-e950-431f-a1e8-3b57c7fd9ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:17:58 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Volume volume-3d6cbd82-4f5d-448a-81de-36a794e92929 (3d6cbd82-4f5d-448a-81de-36a794e92929): created successfully
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a91d860-e950-431f-a1e8-3b57c7fd9ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Flow 'volume_create_manager' (accea0eb-3b26-4271-97a3-e68e4db65594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b048f-53cb-425d-aa5d-f724e8238b35]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:58 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-114a92fe-1508-48a6-85cb-fc1155a3d258 tempest-VolumesAdminNegativeTest-1827990758 None] Created volume successfully.
Apr 15 23:17:58 devstack sudo[83384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21
Apr 15 23:17:58 devstack sudo[83384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:58 devstack sudo[83381]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.449s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:17:58 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-9f58a9b2-bef4-487c-8aab-a5b953cd77b2 tempest-GroupsV314Test-306338191 None] Delete group completed successfully.
Apr 15 23:17:58 devstack sudo[83384]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" returned: 0 in 0.511s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:58 devstack sudo[83390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 1G
Apr 15 23:17:58 devstack sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Acquiring lock "cinder-quobyte-1276a9db-cd09-459e-8d28-d163ce565170" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Lock "cinder-quobyte-1276a9db-cd09-459e-8d28-d163ce565170" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[33880a41-45fc-4dbc-ad52-ea7f9f913f24]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:59 devstack sudo[83395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170
Apr 15 23:17:59 devstack sudo[83395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:59 devstack sudo[83390]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 1G" returned: 0 in 0.557s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:59 devstack sudo[83397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465
Apr 15 23:17:59 devstack sudo[83397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Acquiring lock "cinder-3d6cbd82-4f5d-448a-81de-36a794e92929-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Lock "cinder-3d6cbd82-4f5d-448a-81de-36a794e92929-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Acquiring lock "cinder-quobyte-3d6cbd82-4f5d-448a-81de-36a794e92929" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Lock "cinder-quobyte-3d6cbd82-4f5d-448a-81de-36a794e92929" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60e64cc-31c8-434b-b11a-f134c562162a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:59 devstack sudo[83397]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465" returned: 0 in 0.506s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:59 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:59 devstack sudo[83395]: pam_unix(sudo:session): session closed for user root
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170" returned: 0 in 0.664s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:17:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:17:59 devstack sudo[83405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929
Apr 15 23:17:59 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:59 devstack sudo[83406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465
Apr 15 23:17:59 devstack sudo[83406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:17:59 devstack sudo[83408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170
Apr 15 23:17:59 devstack sudo[83408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:00 devstack sudo[83406]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465" returned: 0 in 0.471s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:00 devstack sudo[83408]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1276a9db-cd09-459e-8d28-d163ce565170" returned: 0 in 0.510s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Lock "cinder-quobyte-1276a9db-cd09-459e-8d28-d163ce565170" released by "delete_volume" :: held 1.206s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:00 devstack sudo[83416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.info
Apr 15 23:18:00 devstack sudo[83416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:00 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929" returned: 0 in 0.629s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Created reservations ['49de4a91-7485-4912-885e-8eb69ff002ee'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:00 devstack sudo[83418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929
Apr 15 23:18:00 devstack sudo[83418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Created reservations ['08649461-88bf-472a-bcb5-998282ea4ded', 'bc363b8f-9178-4c41-a767-3a0b743b9585', 'ab4246fd-2a04-4abf-81c1-a149aaa56713', '504f6a10-e245-4843-b143-02e135de649f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:00 devstack sudo[83420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:00 devstack sudo[83420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:00 devstack sudo[83416]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.info" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:00 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:00 devstack sudo[83424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.info
Apr 15 23:18:00 devstack sudo[83424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:00 devstack sudo[83418]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3d6cbd82-4f5d-448a-81de-36a794e92929" returned: 0 in 0.459s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Lock "cinder-quobyte-3d6cbd82-4f5d-448a-81de-36a794e92929" released by "delete_volume" :: held 1.115s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Created reservations ['79f45de4-d7e0-41bc-af79-d2af68661e47', '1eccee3e-9877-40ab-8323-9c6b3f2e3b5d', '69d0ab05-e80e-45d0-b850-afc0db192e9d', '148ea192-c386-4457-8159-572304924536'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:01 devstack sudo[83427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:01 devstack sudo[83427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:01 devstack sudo[83420]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.499s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:01 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-9f1897f5-5daa-402a-b516-caf0539aa6b8 tempest-GroupsV314Test-306338191 None] Delete group completed successfully.
Apr 15 23:18:01 devstack sudo[83424]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.info" returned: 0 in 0.484s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.086s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:01 devstack sudo[83427]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.496s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:01 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Deleted volume successfully.
Apr 15 23:18:01 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e4855e46-8583-4aa8-b225-7c9d6c2c79b8 tempest-GroupSnapshotsTest-17303575 None] group_snapshot ac600ff2-0773-4747-bce8-e59249e4e84c: created successfully
Apr 15 23:18:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6032273-3004-4967-a254-1eed01dd4fdc tempest-VolumesAdminNegativeTest-1827990758 None] Lock "cinder-3d6cbd82-4f5d-448a-81de-36a794e92929-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-7acd728e-599a-45ed-a839-42f68d1a7465-cb4d7208-3b21-4713-865b-bb6afa7759e7" by "_create_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-7acd728e-599a-45ed-a839-42f68d1a7465-cb4d7208-3b21-4713-865b-bb6afa7759e7" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Creating volume cb4d7208-3b21-4713-865b-bb6afa7759e7 from snapshot 7acd728e-599a-45ed-a839-42f68d1a7465 {{(pid=81941) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-cb4d7208-3b21-4713-865b-bb6afa7759e7" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-cb4d7208-3b21-4713-865b-bb6afa7759e7" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] snapshot: 7acd728e-599a-45ed-a839-42f68d1a7465, volume: cb4d7208-3b21-4713-865b-bb6afa7759e7,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[48252b08-a3e9-4c76-9994-fac0f4b16460]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:03 devstack sudo[83510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465
Apr 15 23:18:03 devstack sudo[83510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:04 devstack sudo[83510]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465" returned: 0 in 0.624s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[272f3ce1-02d9-4df2-9d6b-319bdb24c52c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:04 devstack sudo[83517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21
Apr 15 23:18:04 devstack sudo[83517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:04 devstack sudo[83517]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" returned: 0 in 0.634s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:18:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:04 devstack sudo[83524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7
Apr 15 23:18:04 devstack sudo[83524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:05 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-61c0a422-798e-4956-acee-14c9f8fdb39a req-b0c3c408-66df-4da5-ae22-7643a8e37090 tempest-DeleteServersTestJSON-1475251688 None] Terminate volume connection completed successfully.
Apr 15 23:18:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-61c0a422-798e-4956-acee-14c9f8fdb39a req-b0c3c408-66df-4da5-ae22-7643a8e37090 tempest-DeleteServersTestJSON-1475251688 None] Deleting attachment bb1b819b-bc22-4ebf-871f-7b0820bf0e27. {{(pid=81941) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 23:18:07 devstack sudo[83524]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7" returned: 0 in 2.330s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:07 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d8fcc3-93bf-4f9b-b85b-cafe5353f31f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:07 devstack sudo[83541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21
Apr 15 23:18:07 devstack sudo[83541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:07 devstack sudo[83541]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" returned: 0 in 0.676s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:07 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:18:07 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Converted 1024.00 MB image at 439.25 MB/s
Apr 15 23:18:07 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:18:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:07 devstack sudo[83546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7
Apr 15 23:18:07 devstack sudo[83546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:08 devstack sudo[83546]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-cb4d7208-3b21-4713-865b-bb6afa7759e7" released by "_copy_volume_from_snapshot" :: held 4.776s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-7acd728e-599a-45ed-a839-42f68d1a7465-cb4d7208-3b21-4713-865b-bb6afa7759e7" released by "_create_volume_from_snapshot" :: held 4.809s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.820s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:08 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8082f07b-324a-40d6-ab79-d6afb93bef3b tempest-GroupSnapshotsTest-17303575 None] Create group from source-snapshot-ac600ff2-0773-4747-bce8-e59249e4e84c completed successfully.
Apr 15 23:18:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-cb4d7208-3b21-4713-865b-bb6afa7759e7" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-cb4d7208-3b21-4713-865b-bb6afa7759e7" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:09 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc505954-45f0-4640-b3cb-6dc0f131ffba]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:09 devstack sudo[83549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7
Apr 15 23:18:09 devstack sudo[83549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Acquiring lock "cinder-70abec5a-489f-4f4c-bf8d-449209f72bdf-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Lock "cinder-70abec5a-489f-4f4c-bf8d-449209f72bdf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Acquiring lock "cinder-quobyte-70abec5a-489f-4f4c-bf8d-449209f72bdf" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Lock "cinder-quobyte-70abec5a-489f-4f4c-bf8d-449209f72bdf" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f0d5e-ddb7-4923-b78d-ab445530ab4b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:10 devstack sudo[83549]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7" returned: 0 in 0.659s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:10 devstack sudo[83554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf
Apr 15 23:18:10 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:10 devstack sudo[83555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7
Apr 15 23:18:10 devstack sudo[83555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Flow 'volume_create_manager' (5632e3f8-1484-41e8-843a-4c3cc9772ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e391f0-6b64-420c-8dfa-234ee9780d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e391f0-6b64-420c-8dfa-234ee9780d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1103558825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b151ed43-bcd4-4343-a1df-6798dda86834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2131f0b594af0846ad4a5f7718d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:11Z,use_quota=True,user_id='9643decd0d594b80918d0346f1c75e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba4f1e6-00a9-40d8-bb78-3428b1b1410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba4f1e6-00a9-40d8-bb78-3428b1b1410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a81b43-f688-44c4-987d-138c43b1aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a81b43-f688-44c4-987d-138c43b1aec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b151ed43-bcd4-4343-a1df-6798dda86834', 'volume_name': 'volume-b151ed43-bcd4-4343-a1df-6798dda86834', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080cbe59-b0ee-4e62-9051-f9efcbeb0f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080cbe59-b0ee-4e62-9051-f9efcbeb0f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cd758b-fefd-4c5c-a147-b233e461042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:10 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Volume b151ed43-bcd4-4343-a1df-6798dda86834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b151ed43-bcd4-4343-a1df-6798dda86834', 'volume_size': 1}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1103558825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b151ed43-bcd4-4343-a1df-6798dda86834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2131f0b594af0846ad4a5f7718d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:11Z,use_quota=True,user_id='9643decd0d594b80918d0346f1c75e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Creating volume b151ed43-bcd4-4343-a1df-6798dda86834 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:10 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:10 devstack sudo[83560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834 1073741824
Apr 15 23:18:10 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:10 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf" returned: 0 in 0.574s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:10 devstack sudo[83555]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb4d7208-3b21-4713-865b-bb6afa7759e7" returned: 0 in 0.514s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-cb4d7208-3b21-4713-865b-bb6afa7759e7" released by "delete_volume" :: held 1.215s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:10 devstack sudo[83564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf
Apr 15 23:18:10 devstack sudo[83564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Created reservations ['c2777ff5-6bae-4dc6-b036-ccc1be84594b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:10 devstack cinder-volume[81941]: WARNING cinder.quota [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-35315131 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-35315131, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:18:10 devstack cinder-volume[81941]: WARNING cinder.quota [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-35315131 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-35315131, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:18:10 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Created reservations ['f53071f5-81de-440b-bea6-5dc93364bb9e', 'c92f79cd-5d27-4f00-9662-5cd731ba19e1', '614bd8f4-6898-4196-8789-9d5b1961a18e', '571b84f6-81b3-423c-9fde-2c26111622a6'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:11 devstack sudo[83566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:11 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:11 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834 1073741824" returned: 0 in 0.585s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:11 devstack sudo[83564]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-70abec5a-489f-4f4c-bf8d-449209f72bdf" returned: 0 in 0.460s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Lock "cinder-quobyte-70abec5a-489f-4f4c-bf8d-449209f72bdf" released by "delete_volume" :: held 1.062s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:11 devstack sudo[83573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834
Apr 15 23:18:11 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Created reservations ['88b4e447-ff0c-4cef-a744-ad9a7a981587', 'db9aa779-68b4-48a4-98be-67a72e49d53e', 'c376638c-b1d5-4a81-89c6-cb00c4fe30ce', '466a66a1-7e6b-4850-a6ef-2752a75ac31f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:11 devstack sudo[83575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:11 devstack sudo[83575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:11 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.555s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2b8fe047-7d17-4e03-aab4-3fc6094e20dc tempest-GroupSnapshotsTest-17303575 None] Delete group completed successfully.
Apr 15 23:18:11 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834" returned: 0 in 0.488s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cd758b-fefd-4c5c-a147-b233e461042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b151ed43-bcd4-4343-a1df-6798dda86834', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee0f174-196a-4af0-a3af-cf75ba90c7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:11 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Volume volume-b151ed43-bcd4-4343-a1df-6798dda86834 (b151ed43-bcd4-4343-a1df-6798dda86834): created successfully
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee0f174-196a-4af0-a3af-cf75ba90c7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Flow 'volume_create_manager' (5632e3f8-1484-41e8-843a-4c3cc9772ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-7d2a5aa7-3375-4937-a7b9-911552952ecb tempest-VolumesServicesTestJSON-641205681 None] Created volume successfully.
Apr 15 23:18:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] group_snapshot ac600ff2-0773-4747-bce8-e59249e4e84c: deleting
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] group_snapshot ac600ff2-0773-4747-bce8-e59249e4e84c: deleting {{(pid=81941) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-7acd728e-599a-45ed-a839-42f68d1a7465" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-7acd728e-599a-45ed-a839-42f68d1a7465" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Deleting offline snapshot 7acd728e-599a-45ed-a839-42f68d1a7465 of volume 5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:18:11 devstack sudo[83575]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] snapshot_file for this snap is: volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.523s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae1ce4f-8685-48e1-821f-0f3830e6ab51]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Deleted volume successfully.
Apr 15 23:18:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a9aed7a2-cdb1-4cce-9b39-db74bb8ef744 tempest-DeleteServersTestJSON-1475251688 None] Lock "cinder-70abec5a-489f-4f4c-bf8d-449209f72bdf-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:12 devstack sudo[83580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465
Apr 15 23:18:12 devstack sudo[83580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:12 devstack sudo[83580]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465" returned: 0 in 0.539s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[91414375-3f57-47e1-b550-f3ca89d380c6]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:12 devstack sudo[83585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21
Apr 15 23:18:12 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Acquiring lock "cinder-b151ed43-bcd4-4343-a1df-6798dda86834-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Lock "cinder-b151ed43-bcd4-4343-a1df-6798dda86834-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Acquiring lock "cinder-quobyte-b151ed43-bcd4-4343-a1df-6798dda86834" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Lock "cinder-quobyte-b151ed43-bcd4-4343-a1df-6798dda86834" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc5cb3-e959-44cf-bc37-519f7b9d6a2a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:12 devstack sudo[83587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834
Apr 15 23:18:12 devstack sudo[83587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:13 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" returned: 0 in 0.650s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:13 devstack sudo[83592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465
Apr 15 23:18:13 devstack sudo[83592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:13 devstack sudo[83587]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834" returned: 0 in 0.590s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:13 devstack sudo[83599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834
Apr 15 23:18:13 devstack sudo[83599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:13 devstack sudo[83592]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465" returned: 0 in 0.665s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:13 devstack sudo[83606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465
Apr 15 23:18:13 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:14 devstack sudo[83599]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b151ed43-bcd4-4343-a1df-6798dda86834" returned: 0 in 0.547s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Lock "cinder-quobyte-b151ed43-bcd4-4343-a1df-6798dda86834" released by "delete_volume" :: held 1.160s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Created reservations ['190def54-88d3-443c-a8d5-71cffa80ab17', 'f13c9e7b-e08e-4089-afea-80faad39ab8b', '0d072264-c087-47b7-85b0-94ec1bf95b07', 'ad62cae6-2dff-4c83-8888-63ff8a4a92cc'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:14 devstack sudo[83609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:14 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:14 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21.7acd728e-599a-45ed-a839-42f68d1a7465" returned: 0 in 0.584s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-7acd728e-599a-45ed-a839-42f68d1a7465" released by "_delete_snapshot" :: held 2.498s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" released by "delete_snapshot" :: held 2.510s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:14 devstack cinder-volume[81941]: WARNING cinder.quota [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-35315131 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-35315131, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] Created reservations ['6bfeba97-3256-4574-a41e-2d3bc6394d8d', 'f40c8ef1-6619-4d01-b783-7d9d250280e5', '89b3fdac-7526-4a7c-864c-e2455b452903', '78f6bdbb-a0ec-459f-9bf4-aa4156b634b7'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:14 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6321a092-b5f3-4dcb-a865-71a0e0a04d52 tempest-GroupSnapshotsTest-17303575 None] group_snapshot ac600ff2-0773-4747-bce8-e59249e4e84c: deleted successfully
Apr 15 23:18:14 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.513s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:14 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Deleted volume successfully.
Apr 15 23:18:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4fbf2252-3072-4e25-9f53-df737cb48583 tempest-VolumesServicesTestJSON-641205681 None] Lock "cinder-b151ed43-bcd4-4343-a1df-6798dda86834-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:15 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f328c94-fd99-4968-b49d-52b4b1c7f2dd]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:15 devstack sudo[83615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21
Apr 15 23:18:15 devstack sudo[83615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:15 devstack sudo[83615]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" returned: 0 in 0.602s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:15 devstack sudo[83621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21
Apr 15 23:18:15 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:16 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" returned: 0 in 0.532s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-5a1e58b3-a3a4-4e47-90d8-02d35aed3c21" released by "delete_volume" :: held 1.173s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Created reservations ['2b2f465c-43b5-4314-afc9-cda566bf8a53'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:16 devstack cinder-volume[81941]: WARNING cinder.db.sqlalchemy.api [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-35315131']
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Created reservations ['5dc1ff24-be5e-4fc2-8b67-19859be5d164', '4d4e2f5b-730c-41f7-b128-52adcf7d7201', '1afc7adf-e770-4917-9dc3-3b4756a16399', '26a70ca6-353e-4b86-823c-d482a3887e1f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:16 devstack sudo[83625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:16 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:17 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.492s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:17 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-80b7a0f7-2a70-4ae2-bd8e-9ff28666d2df tempest-GroupSnapshotsTest-17303575 None] Delete group completed successfully.
Apr 15 23:18:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a35a1f3c-416f-4617-bc10-bfd500346d4b tempest-GroupSnapshotsTest-17303575 None] Group tempest-GroupSnapshotsTest-Group-481164473: creating
Apr 15 23:18:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a35a1f3c-416f-4617-bc10-bfd500346d4b tempest-GroupSnapshotsTest-17303575 None] Group tempest-GroupSnapshotsTest-Group-481164473: created successfully
Apr 15 23:18:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a35a1f3c-416f-4617-bc10-bfd500346d4b tempest-GroupSnapshotsTest-17303575 None] Create group completed successfully.
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Flow 'volume_create_manager' (d81f2994-3a7c-476c-8e74-652b9caad65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a8565f-3bc9-4b23-98b1-3cfa919e5a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a8565f-3bc9-4b23-98b1-3cfa919e5a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-326669458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ec80b26f-d223-4eee-95e6-f966da6fe62a,host='devstack@QuobyteHD#QuobyteHD',id=e9bdb5e4-6264-4225-ad16-43832c14acf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c66de2ca7d480a8c80be6e6684e145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:19Z,use_quota=True,user_id='69e09d35adc04c8daf822053b305d39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70288a75-4d18-4724-86d7-609c3617ebee),volume_type_id=70288a75-4d18-4724-86d7-609c3617ebee)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488b5b5a-019a-4c80-8d1d-6475a4009e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488b5b5a-019a-4c80-8d1d-6475a4009e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2820ba7-e9ce-4bbd-92f4-572981593b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2820ba7-e9ce-4bbd-92f4-572981593b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9bdb5e4-6264-4225-ad16-43832c14acf1', 'volume_name': 'volume-e9bdb5e4-6264-4225-ad16-43832c14acf1', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281dffca-f15c-4f2f-a135-032f7301b36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281dffca-f15c-4f2f-a135-032f7301b36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a4f8f9-30f7-4d8d-827f-5e6cba1c065b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:19 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Volume e9bdb5e4-6264-4225-ad16-43832c14acf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9bdb5e4-6264-4225-ad16-43832c14acf1', 'volume_size': 1}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ec80b26f-d223-4eee-95e6-f966da6fe62a,created_at=2026-04-15T21:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-326669458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ec80b26f-d223-4eee-95e6-f966da6fe62a,host='devstack@QuobyteHD#QuobyteHD',id=e9bdb5e4-6264-4225-ad16-43832c14acf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c66de2ca7d480a8c80be6e6684e145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:19Z,use_quota=True,user_id='69e09d35adc04c8daf822053b305d39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70288a75-4d18-4724-86d7-609c3617ebee),volume_type_id=70288a75-4d18-4724-86d7-609c3617ebee)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Creating volume e9bdb5e4-6264-4225-ad16-43832c14acf1 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:19 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:19 devstack sudo[83631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 1073741824
Apr 15 23:18:19 devstack sudo[83631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:19 devstack sudo[83631]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 1073741824" returned: 0 in 0.631s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:20 devstack sudo[83636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1
Apr 15 23:18:20 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:20 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1" returned: 0 in 0.595s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:18:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a4f8f9-30f7-4d8d-827f-5e6cba1c065b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9bdb5e4-6264-4225-ad16-43832c14acf1', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0231fac0-9f3f-4530-8da0-1a826a9a9f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:20 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Volume volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 (e9bdb5e4-6264-4225-ad16-43832c14acf1): created successfully
Apr 15 23:18:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0231fac0-9f3f-4530-8da0-1a826a9a9f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Flow 'volume_create_manager' (d81f2994-3a7c-476c-8e74-652b9caad65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:20 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c42c03f4-9b4b-4231-80fd-a728d0175602 tempest-GroupSnapshotsTest-17303575 None] Created volume successfully.
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Flow 'volume_create_manager' (a41dc86d-867c-4645-b037-731d591bde87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb7ede7-093a-483b-a8da-d2604cb1cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb7ede7-093a-483b-a8da-d2604cb1cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395038889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ec80b26f-d223-4eee-95e6-f966da6fe62a,host='devstack@QuobyteHD#QuobyteHD',id=8218c54c-3af4-48ec-aa89-fb4b7c3331db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c66de2ca7d480a8c80be6e6684e145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:22Z,use_quota=True,user_id='69e09d35adc04c8daf822053b305d39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70288a75-4d18-4724-86d7-609c3617ebee),volume_type_id=70288a75-4d18-4724-86d7-609c3617ebee)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14e6aa3-9bfd-4264-a9f1-c4f15b1bfd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14e6aa3-9bfd-4264-a9f1-c4f15b1bfd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475090ac-6324-45f4-bbce-92a778c6643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475090ac-6324-45f4-bbce-92a778c6643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8218c54c-3af4-48ec-aa89-fb4b7c3331db', 'volume_name': 'volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f81359a-3220-4450-81fa-f6b65be62ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f81359a-3220-4450-81fa-f6b65be62ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b844aa-7947-49d9-a360-c91b87b1a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:21 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Volume 8218c54c-3af4-48ec-aa89-fb4b7c3331db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db', 'volume_size': 1}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ec80b26f-d223-4eee-95e6-f966da6fe62a,created_at=2026-04-15T21:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395038889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ec80b26f-d223-4eee-95e6-f966da6fe62a,host='devstack@QuobyteHD#QuobyteHD',id=8218c54c-3af4-48ec-aa89-fb4b7c3331db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c66de2ca7d480a8c80be6e6684e145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:22Z,use_quota=True,user_id='69e09d35adc04c8daf822053b305d39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70288a75-4d18-4724-86d7-609c3617ebee),volume_type_id=70288a75-4d18-4724-86d7-609c3617ebee)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Creating volume 8218c54c-3af4-48ec-aa89-fb4b7c3331db {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:21 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:18:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:21 devstack sudo[83640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db 1073741824
Apr 15 23:18:21 devstack sudo[83640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:22 devstack sudo[83640]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db 1073741824" returned: 0 in 0.595s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:22 devstack sudo[83645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db
Apr 15 23:18:22 devstack sudo[83645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:23 devstack sudo[83645]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db" returned: 0 in 0.507s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:18:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b844aa-7947-49d9-a360-c91b87b1a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57551076-6d58-4280-b0ce-ca9125736680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:23 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Volume volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db (8218c54c-3af4-48ec-aa89-fb4b7c3331db): created successfully
Apr 15 23:18:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57551076-6d58-4280-b0ce-ca9125736680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Flow 'volume_create_manager' (a41dc86d-867c-4645-b037-731d591bde87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:23 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d158b0e5-f9e1-464f-8a63-218044fe65f6 tempest-GroupSnapshotsTest-17303575 None] Created volume successfully.
Apr 15 23:18:24 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-fca7cf9a-68e7-4048-add1-bd84c784c004 tempest-GroupSnapshotsTest-17303575 None] Update group completed successfully.
Apr 15 23:18:25 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a01e1ace-6488-4810-9edf-38a1351d1f24 tempest-GroupSnapshotsTest-17303575 None] Update group completed successfully.
Apr 15 23:18:26 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-449d8452-dc1c-415f-a44d-a126cd0cce4f tempest-GroupSnapshotsTest-17303575 None] Update group completed successfully.
Apr 15 23:18:27 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d565cd35-eae3-478d-92c0-81b1e355cc17 tempest-GroupSnapshotsTest-17303575 None] Update group completed successfully.
Apr 15 23:18:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] GroupSnapshot 089a7623-3175-4788-83f2-683d9fea6d84: creating.
Apr 15 23:18:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Group snapshot 089a7623-3175-4788-83f2-683d9fea6d84: creating. {{(pid=81941) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 23:18:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Creating offline snapshot 1ab58162-b477-4f4d-a5c7-2e727a4bb334 of volume e9bdb5e4-6264-4225-ad16-43832c14acf1 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:18:29 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca885c-823a-449a-bc77-5dd8981f8064]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:29 devstack sudo[83657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1
Apr 15 23:18:29 devstack sudo[83657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:29 devstack sudo[83657]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1" returned: 0 in 0.610s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:29 devstack sudo[83662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 1G
Apr 15 23:18:29 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:30 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 1G" returned: 0 in 0.677s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:30 devstack sudo[83667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334
Apr 15 23:18:30 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=122,cinder:UPDATE=116,cinder:INSERT=26,cinder:DELETE=8 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Flow 'volume_create_manager' (85681a6b-6a65-4bd4-a452-672553d4cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a58718-c2d8-4f67-bf08-1fa739894e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a58718-c2d8-4f67-bf08-1fa739894e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-221529849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3964bc-1a35-4813-b4dc-15c639280bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4275a6152b4244b7baf6debc81fba417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:30Z,use_quota=True,user_id='3fea228d36124625beebd6c6bde7a5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa6cf0d-cb5e-49c2-86ae-7589f4cbbdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa6cf0d-cb5e-49c2-86ae-7589f4cbbdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9362e8-201d-4032-9ad5-5240a57aa85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9362e8-201d-4032-9ad5-5240a57aa85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3964bc-1a35-4813-b4dc-15c639280bde', 'volume_name': 'volume-cd3964bc-1a35-4813-b4dc-15c639280bde', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f08b14-5c42-45fa-9675-80b035c73979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f08b14-5c42-45fa-9675-80b035c73979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb569cc8-7263-4808-8569-8463fb938233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:30 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Volume cd3964bc-1a35-4813-b4dc-15c639280bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3964bc-1a35-4813-b4dc-15c639280bde', 'volume_size': 1}
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:30 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334" returned: 0 in 0.586s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:30 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:18:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:30 devstack sudo[83673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334
Apr 15 23:18:30 devstack sudo[83673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:31 devstack sudo[83673]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:31 devstack sudo[83676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.info
Apr 15 23:18:31 devstack sudo[83676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:31 devstack sudo[83676]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.info" returned: 0 in 0.586s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:31 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:18:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:31 devstack sudo[83680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.info
Apr 15 23:18:31 devstack sudo[83680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:32 devstack sudo[83680]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.info" returned: 0 in 0.421s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.403s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Creating offline snapshot cd86d668-19fc-4b1b-844a-bb3076815a7a of volume 8218c54c-3af4-48ec-aa89-fb4b7c3331db {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37d240b-d2ec-484c-a241-ad16556d951a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:32 devstack sudo[83691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db
Apr 15 23:18:32 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:32 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db" returned: 0 in 0.500s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:32 devstack sudo[83710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a 1G
Apr 15 23:18:32 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:33 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a 1G" returned: 0 in 0.494s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:33 devstack sudo[83719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a
Apr 15 23:18:33 devstack sudo[83719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:33 devstack sudo[83719]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:33 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:18:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:33 devstack sudo[83727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a
Apr 15 23:18:33 devstack sudo[83727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:34 devstack sudo[83727]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a" returned: 0 in 0.413s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:34 devstack sudo[83730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.info
Apr 15 23:18:34 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:34 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.info" returned: 0 in 0.422s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:34 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:18:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:34 devstack sudo[83733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.info
Apr 15 23:18:34 devstack sudo[83733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:35 devstack sudo[83733]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.info" returned: 0 in 0.410s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.665s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-221529849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3964bc-1a35-4813-b4dc-15c639280bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4275a6152b4244b7baf6debc81fba417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:30Z,use_quota=True,user_id='3fea228d36124625beebd6c6bde7a5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Creating volume cd3964bc-1a35-4813-b4dc-15c639280bde {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:35 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:35 devstack sudo[83739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde 1073741824
Apr 15 23:18:35 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e50597c5-f1b3-4858-8fd8-e206b40ad907 tempest-GroupSnapshotsTest-17303575 None] group_snapshot 089a7623-3175-4788-83f2-683d9fea6d84: created successfully
Apr 15 23:18:35 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde 1073741824" returned: 0 in 0.523s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:35 devstack sudo[83745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde
Apr 15 23:18:35 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:36 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde" returned: 0 in 0.389s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb569cc8-7263-4808-8569-8463fb938233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3964bc-1a35-4813-b4dc-15c639280bde', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3db271-48fc-4e7f-ae88-c5c6df41207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:36 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Volume volume-cd3964bc-1a35-4813-b4dc-15c639280bde (cd3964bc-1a35-4813-b4dc-15c639280bde): created successfully
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3db271-48fc-4e7f-ae88-c5c6df41207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Flow 'volume_create_manager' (85681a6b-6a65-4bd4-a452-672553d4cda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e725aa5f-d970-421d-8e9f-57f4152e3fc9 tempest-VolumesListAdminTestJSON-489006401 None] Created volume successfully.
Apr 15 23:18:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] group_snapshot 089a7623-3175-4788-83f2-683d9fea6d84: deleting
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] group_snapshot 089a7623-3175-4788-83f2-683d9fea6d84: deleting {{(pid=81941) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-e9bdb5e4-6264-4225-ad16-43832c14acf1" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-e9bdb5e4-6264-4225-ad16-43832c14acf1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-1ab58162-b477-4f4d-a5c7-2e727a4bb334" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-1ab58162-b477-4f4d-a5c7-2e727a4bb334" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Deleting offline snapshot 1ab58162-b477-4f4d-a5c7-2e727a4bb334 of volume e9bdb5e4-6264-4225-ad16-43832c14acf1 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] snapshot_file for this snap is: volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff0f822-942d-4e04-b6d1-821aa70a04d0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:36 devstack sudo[83749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334
Apr 15 23:18:36 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:37 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334" returned: 0 in 0.628s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9bdb5e4-6264-4225-ad16-43832c14acf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd07129-0fe1-47f0-9912-f95f76d54f88]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:18:37 devstack sudo[83779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1
Apr 15 23:18:37 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Flow 'volume_create_manager' (dc0ddccb-23e8-4469-9927-396f89fb98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935066e7-6a3c-4b58-b0c3-f290a7979055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935066e7-6a3c-4b58-b0c3-f290a7979055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-705627362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcf3274-94f5-4e18-9854-7219b9c37cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4275a6152b4244b7baf6debc81fba417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:37Z,use_quota=True,user_id='3fea228d36124625beebd6c6bde7a5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a45e77-975b-4eb7-a9f5-fc3fe8ce54ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a45e77-975b-4eb7-a9f5-fc3fe8ce54ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a16b3d5-be85-42a3-bc73-143b3829c1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a16b3d5-be85-42a3-bc73-143b3829c1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcf3274-94f5-4e18-9854-7219b9c37cc6', 'volume_name': 'volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465be184-e907-4783-b495-384fc873e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465be184-e907-4783-b495-384fc873e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac67dc2-319a-48da-9df4-20616ae2d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:37 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Volume 3fcf3274-94f5-4e18-9854-7219b9c37cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6', 'volume_size': 1}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-705627362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcf3274-94f5-4e18-9854-7219b9c37cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4275a6152b4244b7baf6debc81fba417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:37Z,use_quota=True,user_id='3fea228d36124625beebd6c6bde7a5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Creating volume 3fcf3274-94f5-4e18-9854-7219b9c37cc6 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:37 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:37 devstack sudo[83782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6 1073741824
Apr 15 23:18:37 devstack sudo[83782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:37 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1" returned: 0 in 0.550s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:37 devstack sudo[83789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334
Apr 15 23:18:37 devstack sudo[83789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:37 devstack sudo[83782]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6 1073741824" returned: 0 in 0.590s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:37 devstack sudo[83794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6
Apr 15 23:18:37 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:38 devstack sudo[83789]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334" returned: 0 in 0.661s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:38 devstack sudo[83799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334
Apr 15 23:18:38 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:38 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6" returned: 0 in 0.578s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac67dc2-319a-48da-9df4-20616ae2d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f235f7a6-41ff-42af-925e-78af9ce98f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:38 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Volume volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6 (3fcf3274-94f5-4e18-9854-7219b9c37cc6): created successfully
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f235f7a6-41ff-42af-925e-78af9ce98f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Flow 'volume_create_manager' (dc0ddccb-23e8-4469-9927-396f89fb98c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cd09b04c-190c-463d-a097-1c9c89e75db1 tempest-VolumesListAdminTestJSON-489006401 None] Created volume successfully.
Apr 15 23:18:38 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1.1ab58162-b477-4f4d-a5c7-2e727a4bb334" returned: 0 in 0.482s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-1ab58162-b477-4f4d-a5c7-2e727a4bb334" released by "_delete_snapshot" :: held 2.403s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-e9bdb5e4-6264-4225-ad16-43832c14acf1" released by "delete_snapshot" :: held 2.415s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-8218c54c-3af4-48ec-aa89-fb4b7c3331db" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-8218c54c-3af4-48ec-aa89-fb4b7c3331db" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-cd86d668-19fc-4b1b-844a-bb3076815a7a" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-cd86d668-19fc-4b1b-844a-bb3076815a7a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Deleting offline snapshot cd86d668-19fc-4b1b-844a-bb3076815a7a of volume 8218c54c-3af4-48ec-aa89-fb4b7c3331db {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] snapshot_file for this snap is: volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb285d9-caeb-4c24-9d7f-f20026f156c0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:38 devstack sudo[83805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a
Apr 15 23:18:38 devstack sudo[83805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:39 devstack sudo[83805]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a" returned: 0 in 0.575s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa385aa-2e6a-4313-b2d7-6a9a2b9f8c6b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:39 devstack sudo[83819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db
Apr 15 23:18:39 devstack sudo[83819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Flow 'volume_create_manager' (0c570f40-33b7-4137-b143-191432f8245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa23fb90-54e1-4383-a12b-e7ebb50b165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa23fb90-54e1-4383-a12b-e7ebb50b165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1704895118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b009e42-1122-41b2-8364-3a0320ffd30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4275a6152b4244b7baf6debc81fba417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:40Z,use_quota=True,user_id='3fea228d36124625beebd6c6bde7a5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925dd5f8-4248-42b5-8096-c5a97a153c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925dd5f8-4248-42b5-8096-c5a97a153c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99ae2e8-5288-489f-8b79-ce034b923ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99ae2e8-5288-489f-8b79-ce034b923ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b009e42-1122-41b2-8364-3a0320ffd30f', 'volume_name': 'volume-5b009e42-1122-41b2-8364-3a0320ffd30f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647c8d03-43ea-4293-8a88-7a86d263138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647c8d03-43ea-4293-8a88-7a86d263138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746288bc-1c16-4147-99da-253a7813fa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:39 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Volume 5b009e42-1122-41b2-8364-3a0320ffd30f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b009e42-1122-41b2-8364-3a0320ffd30f', 'volume_size': 1}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1704895118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b009e42-1122-41b2-8364-3a0320ffd30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4275a6152b4244b7baf6debc81fba417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:40Z,use_quota=True,user_id='3fea228d36124625beebd6c6bde7a5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Creating volume 5b009e42-1122-41b2-8364-3a0320ffd30f {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:39 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:18:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:39 devstack sudo[83829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f 1073741824
Apr 15 23:18:39 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:40 devstack sudo[83819]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db" returned: 0 in 0.581s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:40 devstack sudo[83836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a
Apr 15 23:18:40 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:40 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f 1073741824" returned: 0 in 0.599s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=132,cinder:UPDATE=134,cinder:DELETE=5,cinder:INSERT=28 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:40 devstack sudo[83841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f
Apr 15 23:18:40 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:40 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a" returned: 0 in 0.525s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:40 devstack sudo[83857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a
Apr 15 23:18:40 devstack sudo[83857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:40 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f" returned: 0 in 0.624s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:18:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746288bc-1c16-4147-99da-253a7813fa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b009e42-1122-41b2-8364-3a0320ffd30f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101da27f-2693-4a22-8672-85c08acd4a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Volume volume-5b009e42-1122-41b2-8364-3a0320ffd30f (5b009e42-1122-41b2-8364-3a0320ffd30f): created successfully
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101da27f-2693-4a22-8672-85c08acd4a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Flow 'volume_create_manager' (0c570f40-33b7-4137-b143-191432f8245a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-251c1300-a5dd-4fb8-90d1-c27a5ac040e2 tempest-VolumesListAdminTestJSON-489006401 None] Created volume successfully.
Apr 15 23:18:41 devstack sudo[83857]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db.cd86d668-19fc-4b1b-844a-bb3076815a7a" returned: 0 in 0.689s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-cd86d668-19fc-4b1b-844a-bb3076815a7a" released by "_delete_snapshot" :: held 2.431s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-8218c54c-3af4-48ec-aa89-fb4b7c3331db" released by "delete_snapshot" :: held 2.445s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:41 devstack cinder-volume[81941]: WARNING cinder.quota [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1250670420 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1250670420, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:18:41 devstack cinder-volume[81941]: WARNING cinder.quota [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1250670420 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1250670420, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Created reservations ['5da37668-dbb0-4d0a-a364-38235f9d51ee', 'b70e05d7-c0ce-4b02-ada7-9cbe852214d3', '9d1496e6-67ac-4066-be13-71ae9e4d1bf5', 'b3e10f30-1545-407b-8d30-3c035ac66d04'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] Created reservations ['de5e2846-aeea-485a-a9c9-915c53d3a8e2', 'aa26697b-49d7-4adc-a0e5-c711325868ba', '1abf04fd-31d0-4ba7-8964-6bbd69effea8', '78f993a9-67ce-4b3d-9f05-324aeb9460a5'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-94a552ac-e11c-4196-af6a-1609759280e8 tempest-GroupSnapshotsTest-17303575 None] group_snapshot 089a7623-3175-4788-83f2-683d9fea6d84: deleted successfully
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-8218c54c-3af4-48ec-aa89-fb4b7c3331db" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-8218c54c-3af4-48ec-aa89-fb4b7c3331db" acquired by "delete_volume" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[183667c3-ef42-4468-97c0-1c0b617c96f8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:42 devstack sudo[83889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db
Apr 15 23:18:42 devstack sudo[83889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Flow 'volume_create_manager' (637316d6-4fd2-4ca3-a690-8cfdc9163982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cbef5c-5f11-41ec-bcc2-880c5dab3d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cbef5c-5f11-41ec-bcc2-880c5dab3d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2a6b0d-3540-48d8-b92c-7fd407eadae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd17a749695e44f1bdd135ae6d2967c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:42Z,use_quota=True,user_id='48accce4235a41bf8f8de38758ce67e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861851e7-d526-4e4d-a3c7-f45222bfe122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861851e7-d526-4e4d-a3c7-f45222bfe122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ea9d82-bda7-4985-a9e8-e4ca25f4d339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ea9d82-bda7-4985-a9e8-e4ca25f4d339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2a6b0d-3540-48d8-b92c-7fd407eadae3', 'volume_name': 'volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec40e11f-9afd-4adc-b823-12fb1b858814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec40e11f-9afd-4adc-b823-12fb1b858814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691bc3b3-5bc2-4590-a972-2dcaf79e168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:42 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Volume 4b2a6b0d-3540-48d8-b92c-7fd407eadae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3', 'volume_size': 1}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2a6b0d-3540-48d8-b92c-7fd407eadae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd17a749695e44f1bdd135ae6d2967c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:42Z,use_quota=True,user_id='48accce4235a41bf8f8de38758ce67e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Creating volume 4b2a6b0d-3540-48d8-b92c-7fd407eadae3 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:42 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:42 devstack sudo[83897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3 1073741824
Apr 15 23:18:42 devstack sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:42 devstack sudo[83889]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db" returned: 0 in 0.776s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:42 devstack sudo[83902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db
Apr 15 23:18:42 devstack sudo[83902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:43 devstack sudo[83897]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3 1073741824" returned: 0 in 0.601s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:43 devstack sudo[83909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3
Apr 15 23:18:43 devstack sudo[83909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:43 devstack sudo[83902]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8218c54c-3af4-48ec-aa89-fb4b7c3331db" returned: 0 in 0.568s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-8218c54c-3af4-48ec-aa89-fb4b7c3331db" released by "delete_volume" :: held 1.444s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-e9bdb5e4-6264-4225-ad16-43832c14acf1" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-e9bdb5e4-6264-4225-ad16-43832c14acf1" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[04447098-2a0c-4694-8259-4ed4347a4b18]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:43 devstack sudo[83912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1
Apr 15 23:18:43 devstack sudo[83912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:43 devstack sudo[83909]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3" returned: 0 in 0.433s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691bc3b3-5bc2-4590-a972-2dcaf79e168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e815f55-89e4-4014-9851-7ff5ca20a8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:43 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Volume volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3 (4b2a6b0d-3540-48d8-b92c-7fd407eadae3): created successfully
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e815f55-89e4-4014-9851-7ff5ca20a8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Flow 'volume_create_manager' (637316d6-4fd2-4ca3-a690-8cfdc9163982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:43 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f34f4ef7-202a-4e3b-a2c5-2d5be44b9b08 tempest-VolumesListAdminTestJSON-101391592 None] Created volume successfully.
Apr 15 23:18:43 devstack sudo[83912]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1" returned: 0 in 0.516s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:43 devstack sudo[83918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1
Apr 15 23:18:43 devstack sudo[83918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:44 devstack sudo[83918]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e9bdb5e4-6264-4225-ad16-43832c14acf1" returned: 0 in 0.590s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-e9bdb5e4-6264-4225-ad16-43832c14acf1" released by "delete_volume" :: held 1.142s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:44 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Created reservations ['ea202d2b-0d11-479a-a2ab-7bf32fc97c8d'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:44 devstack cinder-volume[81941]: WARNING cinder.quota [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1250670420 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1250670420, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:18:44 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Created reservations ['bc3a80f8-51d4-4f4f-910c-03d46363fc78', 'efcbc4f9-4a46-414e-a74c-a04fa6c32980', 'dff2d3c8-e24f-48cc-b330-275a063c4e6f', '0fab1fa4-83ec-4b5c-806d-56a527ba438d'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Acquiring lock "cinder-4b2a6b0d-3540-48d8-b92c-7fd407eadae3-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "cinder-5b009e42-1122-41b2-8364-3a0320ffd30f-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Lock "cinder-4b2a6b0d-3540-48d8-b92c-7fd407eadae3-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-5b009e42-1122-41b2-8364-3a0320ffd30f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Acquiring lock "cinder-quobyte-4b2a6b0d-3540-48d8-b92c-7fd407eadae3" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "cinder-quobyte-5b009e42-1122-41b2-8364-3a0320ffd30f" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Created reservations ['f9daaf43-c116-4f6b-8f1f-aa1a5fdccd10', '973d7511-ac25-4e27-8122-023fdc8c5740', '02fc5b80-0938-42cb-bd0d-ff7e322e1897', '6768d07d-0ff1-460f-841e-ac1a7ecd5434'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Lock "cinder-quobyte-4b2a6b0d-3540-48d8-b92c-7fd407eadae3" acquired by "delete_volume" :: waited 0.075s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7c8e81-341c-428d-a3c6-c8049a55b3a4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-quobyte-5b009e42-1122-41b2-8364-3a0320ffd30f" acquired by "delete_volume" :: waited 0.139s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fbec44-86e3-49fb-a48a-142ee145a626]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:45 devstack sudo[83954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f
Apr 15 23:18:45 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:45 devstack sudo[83956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:45 devstack sudo[83956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:45 devstack sudo[83953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3
Apr 15 23:18:45 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:46 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f" returned: 0 in 0.654s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:46 devstack sudo[83964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f
Apr 15 23:18:46 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:46 devstack sudo[83956]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.716s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:46 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:46 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-33ea4932-cc62-4d25-8ad4-c90e061b9449 tempest-GroupSnapshotsTest-17303575 None] Delete group completed successfully.
Apr 15 23:18:46 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3" returned: 0 in 0.914s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:46 devstack sudo[83968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3
Apr 15 23:18:46 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:46 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5b009e42-1122-41b2-8364-3a0320ffd30f" returned: 0 in 0.888s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-quobyte-5b009e42-1122-41b2-8364-3a0320ffd30f" released by "delete_volume" :: held 1.606s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Created reservations ['ec559806-12e5-49c5-91da-d27ea685af2f', '251b9624-8f3d-4dfb-9e9d-22cf240b220c', '70834e2d-4514-4611-a58f-39dcddec4ce2', '6e9d41d5-7ffa-4a05-8aa3-de16c0a3f39a'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:47 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2e3133c1-7aa3-4924-b009-78e3a6936d96 tempest-GroupSnapshotsTest-17303575 None] Group tempest-GroupSnapshotsTest-Group-971502085: creating
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:47 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4b2a6b0d-3540-48d8-b92c-7fd407eadae3" returned: 0 in 1.024s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Lock "cinder-quobyte-4b2a6b0d-3540-48d8-b92c-7fd407eadae3" released by "delete_volume" :: held 2.025s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:47 devstack sudo[83990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:47 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:47 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2e3133c1-7aa3-4924-b009-78e3a6936d96 tempest-GroupSnapshotsTest-17303575 None] Group tempest-GroupSnapshotsTest-Group-971502085: created successfully
Apr 15 23:18:47 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2e3133c1-7aa3-4924-b009-78e3a6936d96 tempest-GroupSnapshotsTest-17303575 None] Create group completed successfully.
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Created reservations ['5d6be4b0-1efe-46f0-b01f-b99ed44c16a1', '44be97b2-0bb3-4425-938d-5a2420615c51', '880ec0a6-506b-4b25-8867-edba30452dab', '5747a9b3-2e1e-4b1b-a78d-b2b360fc6811'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:47 devstack sudo[83996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:47 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "cinder-3fcf3274-94f5-4e18-9854-7219b9c37cc6-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-3fcf3274-94f5-4e18-9854-7219b9c37cc6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "cinder-quobyte-3fcf3274-94f5-4e18-9854-7219b9c37cc6" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-quobyte-3fcf3274-94f5-4e18-9854-7219b9c37cc6" acquired by "delete_volume" :: waited 0.023s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861c88e-52a4-4f4d-807f-2125bb2f6d8d]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:47 devstack sudo[84003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6
Apr 15 23:18:47 devstack sudo[84003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:48 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.613s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:48 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Deleted volume successfully.
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9644c069-76db-471e-8138-99c2ffd2132a tempest-VolumesListAdminTestJSON-101391592 None] Lock "cinder-4b2a6b0d-3540-48d8-b92c-7fd407eadae3-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:48 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 1.079s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:48 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Deleted volume successfully.
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-00e86d74-1be8-4382-a6ae-39d9fe8744cb tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-5b009e42-1122-41b2-8364-3a0320ffd30f-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Flow 'volume_create_manager' (cc6d4c58-1a52-4e2d-a648-365096f4572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1510b5a8-0ac5-48f6-9b62-63df56eb3699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1510b5a8-0ac5-48f6-9b62-63df56eb3699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392063412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df61fe69-1834-4493-b581-51e99dd6b89f,host='devstack@QuobyteHD#QuobyteHD',id=fc02b2a3-d364-4e0d-b70e-26edc3fac7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c66de2ca7d480a8c80be6e6684e145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:49Z,use_quota=True,user_id='69e09d35adc04c8daf822053b305d39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aed5dda3-79b0-4cae-bb64-7dd24b359bfd),volume_type_id=aed5dda3-79b0-4cae-bb64-7dd24b359bfd)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1d250e-0fdd-4987-9048-5bbc4d4a4501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1d250e-0fdd-4987-9048-5bbc4d4a4501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381b3e4f-68e1-492d-8e0b-ccba510889ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381b3e4f-68e1-492d-8e0b-ccba510889ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc02b2a3-d364-4e0d-b70e-26edc3fac7ba', 'volume_name': 'volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9aaaf34-7e0c-479e-8266-905140d53e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9aaaf34-7e0c-479e-8266-905140d53e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1517cabb-4de4-4f50-b04d-3c0b91bfd377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:49 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Volume fc02b2a3-d364-4e0d-b70e-26edc3fac7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba', 'volume_size': 1}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df61fe69-1834-4493-b581-51e99dd6b89f,created_at=2026-04-15T21:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392063412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df61fe69-1834-4493-b581-51e99dd6b89f,host='devstack@QuobyteHD#QuobyteHD',id=fc02b2a3-d364-4e0d-b70e-26edc3fac7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c66de2ca7d480a8c80be6e6684e145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:49Z,use_quota=True,user_id='69e09d35adc04c8daf822053b305d39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aed5dda3-79b0-4cae-bb64-7dd24b359bfd),volume_type_id=aed5dda3-79b0-4cae-bb64-7dd24b359bfd)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Creating volume fc02b2a3-d364-4e0d-b70e-26edc3fac7ba {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:18:49 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:49 devstack sudo[84013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba 1073741824
Apr 15 23:18:49 devstack sudo[84013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:49 devstack sudo[84003]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6" returned: 0 in 1.532s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:49 devstack sudo[84018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6
Apr 15 23:18:49 devstack sudo[84018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:50 devstack sudo[84018]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fcf3274-94f5-4e18-9854-7219b9c37cc6" returned: 0 in 0.770s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-quobyte-3fcf3274-94f5-4e18-9854-7219b9c37cc6" released by "delete_volume" :: held 2.345s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Created reservations ['25637218-d5a6-4851-ae41-c9b794f7f86c', '9410314b-2814-4674-a44f-dcba74feb7a1', '1defd9eb-aab5-4607-9891-6dac1139bb3f', '58c2ea5e-a41f-4965-8e70-8e4aaa401047'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:50 devstack sudo[84013]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba 1073741824" returned: 0 in 1.207s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:50 devstack sudo[84024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:50 devstack sudo[84024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:50 devstack sudo[84025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba
Apr 15 23:18:50 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:50 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" returned: 0 in 0.629s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1517cabb-4de4-4f50-b04d-3c0b91bfd377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c37d45-155d-482c-9547-b01d6e71e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:18:50 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Volume volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba (fc02b2a3-d364-4e0d-b70e-26edc3fac7ba): created successfully
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c37d45-155d-482c-9547-b01d6e71e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Flow 'volume_create_manager' (cc6d4c58-1a52-4e2d-a648-365096f4572e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:18:50 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4e3f7759-7a33-4f12-b7cf-f29e8a7f15b5 tempest-GroupSnapshotsTest-17303575 None] Created volume successfully.
Apr 15 23:18:50 devstack sudo[84024]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.711s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:50 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Deleted volume successfully.
Apr 15 23:18:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3d36d35a-727f-4a49-80c7-95eca1a5c7fa tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-3fcf3274-94f5-4e18-9854-7219b9c37cc6-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "cinder-cd3964bc-1a35-4813-b4dc-15c639280bde-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-cd3964bc-1a35-4813-b4dc-15c639280bde-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "cinder-quobyte-cd3964bc-1a35-4813-b4dc-15c639280bde" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-quobyte-cd3964bc-1a35-4813-b4dc-15c639280bde" acquired by "delete_volume" :: waited 0.023s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99bd1fc-d3bf-459a-a017-f489250b50ea]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] GroupSnapshot 8b775be7-9ec2-48b0-9e58-200fc59fa479: creating.
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Group snapshot 8b775be7-9ec2-48b0-9e58-200fc59fa479: creating. {{(pid=81941) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:51 devstack sudo[84030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde
Apr 15 23:18:51 devstack sudo[84030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Creating offline snapshot 329c705c-c60e-40db-b912-5ee8a7456491 of volume fc02b2a3-d364-4e0d-b70e-26edc3fac7ba {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46956b2-89a1-42d3-b56b-01b4a69f56d9]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:51 devstack sudo[84032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba
Apr 15 23:18:51 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:51 devstack sudo[84030]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde" returned: 0 in 0.695s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:51 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" returned: 0 in 0.630s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:52 devstack sudo[84040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde
Apr 15 23:18:52 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:52 devstack sudo[84041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 1G
Apr 15 23:18:52 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:52 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd3964bc-1a35-4813-b4dc-15c639280bde" returned: 0 in 0.689s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-quobyte-cd3964bc-1a35-4813-b4dc-15c639280bde" released by "delete_volume" :: held 1.419s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Created reservations ['96d1a9ff-dfc7-4c74-bf1a-6a1ebabd2c01', '975ed9e2-a064-45da-8ce1-a8c22bc37701', '278a75d0-c219-4f2b-a745-9619737d91e9', '4efdf5dc-eb9a-4fb4-b3b2-144686739efc'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:52 devstack sudo[84049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:52 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:52 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 1G" returned: 0 in 0.991s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:53 devstack sudo[84054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491
Apr 15 23:18:53 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:53 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491" returned: 0 in 0.928s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:53 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:18:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:53 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 1.155s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:53 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:53 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Deleted volume successfully.
Apr 15 23:18:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-60463adf-ad27-4cea-9f3a-a37948889f2e tempest-VolumesListAdminTestJSON-489006401 None] Lock "cinder-cd3964bc-1a35-4813-b4dc-15c639280bde-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:18:54 devstack sudo[84061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491
Apr 15 23:18:54 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:54 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491" returned: 0 in 1.072s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:55 devstack sudo[84071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.info
Apr 15 23:18:55 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:56 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.info" returned: 0 in 1.179s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:56 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:18:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:56 devstack sudo[84087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.info
Apr 15 23:18:56 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:57 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.info" returned: 0 in 0.798s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.756s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:57 devstack sudo[84092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:18:57 devstack sudo[84092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3f7198c2-fd50-486f-a64a-651c835bccab tempest-GroupSnapshotsTest-17303575 None] group_snapshot 8b775be7-9ec2-48b0-9e58-200fc59fa479: created successfully
Apr 15 23:18:57 devstack sudo[84092]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.557s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:18:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] group_snapshot 8b775be7-9ec2-48b0-9e58-200fc59fa479: deleting
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] group_snapshot 8b775be7-9ec2-48b0-9e58-200fc59fa479: deleting {{(pid=81941) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-329c705c-c60e-40db-b912-5ee8a7456491" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:18:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-329c705c-c60e-40db-b912-5ee8a7456491" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:18:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Deleting offline snapshot 329c705c-c60e-40db-b912-5ee8a7456491 of volume fc02b2a3-d364-4e0d-b70e-26edc3fac7ba {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:18:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] snapshot_file for this snap is: volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:18:58 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc24f8f4-eed7-45a9-a7aa-2f606fda8db3]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:58 devstack sudo[84095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491
Apr 15 23:18:58 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:18:59 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root
Apr 15 23:18:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491" returned: 0 in 1.404s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:18:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:18:59 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[527f9454-aef7-4d13-9301-13924e2219d7]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:18:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:18:59 devstack sudo[84102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba
Apr 15 23:18:59 devstack sudo[84102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:00 devstack sudo[84102]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" returned: 0 in 1.035s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:00 devstack sudo[84112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491
Apr 15 23:19:00 devstack sudo[84112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Flow 'volume_create_manager' (e3488c41-4460-40a6-a1b4-9bf65d6b56d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f7c2c7-1f3b-4179-a547-af0d4036f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Flow 'volume_create_manager' (e53f3089-c0ea-4115-9436-983f8db50056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173f5ed1-7f8c-4fa1-aad4-d5df0c816003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173f5ed1-7f8c-4fa1-aad4-d5df0c816003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:00Z,deleted=False,deleted_at=None,display_description='',display_name='f836c39d-8e80-47fa-b3b8-0cdf0bf0cc5d-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cdaca6-d4c8-4984-8c9e-89ca0a57e56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d736efcab6fa4adfa4a5e1de8aeb52ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:01Z,use_quota=True,user_id='fef97315bc3c4af79a42e5812cfcd0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdc2b9e-bf5e-4156-bbf7-486bf5c7bee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdc2b9e-bf5e-4156-bbf7-486bf5c7bee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02538384-ac71-4669-9dbd-8e29486e853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02538384-ac71-4669-9dbd-8e29486e853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60cdaca6-d4c8-4984-8c9e-89ca0a57e56f', 'volume_name': 'volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b82237-6864-411c-b387-d2390da993bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b82237-6864-411c-b387-d2390da993bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd66f267-0a85-47bb-b32f-7d2db8747181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:01 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Volume 60cdaca6-d4c8-4984-8c9e-89ca0a57e56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f', 'volume_size': 1}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:00Z,deleted=False,deleted_at=None,display_description='',display_name='f836c39d-8e80-47fa-b3b8-0cdf0bf0cc5d-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60cdaca6-d4c8-4984-8c9e-89ca0a57e56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d736efcab6fa4adfa4a5e1de8aeb52ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:01Z,use_quota=True,user_id='fef97315bc3c4af79a42e5812cfcd0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Creating volume 60cdaca6-d4c8-4984-8c9e-89ca0a57e56f {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:01 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f7c2c7-1f3b-4179-a547-af0d4036f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1181206272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361b876d-eafa-4103-a4cc-9ef5ffce794d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928c14ee1ad24ffb80972d12b143cd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:01Z,use_quota=True,user_id='7d30e0144ccd490588d24f23127555d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9c5320-a2e1-4606-9142-f54e593308b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9c5320-a2e1-4606-9142-f54e593308b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:01 devstack sudo[84114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f 1073741824
Apr 15 23:19:01 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc6449f-5c32-4ec7-8fcf-1e33b38ba09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc6449f-5c32-4ec7-8fcf-1e33b38ba09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361b876d-eafa-4103-a4cc-9ef5ffce794d', 'volume_name': 'volume-361b876d-eafa-4103-a4cc-9ef5ffce794d', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822033e0-7463-4927-9a21-690fbdf8ca2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822033e0-7463-4927-9a21-690fbdf8ca2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464fc7be-cdb9-4b68-919f-a0b2d52c53e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:01 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Volume 361b876d-eafa-4103-a4cc-9ef5ffce794d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361b876d-eafa-4103-a4cc-9ef5ffce794d', 'volume_size': 1}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:01 devstack sudo[84112]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491" returned: 0 in 0.891s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:01 devstack sudo[84119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491
Apr 15 23:19:01 devstack sudo[84119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:02 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f 1073741824" returned: 0 in 1.318s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:02 devstack sudo[84154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f
Apr 15 23:19:02 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:02 devstack sudo[84119]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba.329c705c-c60e-40db-b912-5ee8a7456491" returned: 0 in 1.219s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-329c705c-c60e-40db-b912-5ee8a7456491" released by "_delete_snapshot" :: held 4.792s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" released by "delete_snapshot" :: held 4.820s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:02 devstack cinder-volume[81941]: WARNING cinder.quota [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-824835198 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-824835198, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:19:02 devstack cinder-volume[81941]: WARNING cinder.quota [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-824835198 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-824835198, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:19:02 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] Created reservations ['d2e64d52-fd3c-4eb7-ad3e-5ddfaa0f0e8a', '531c4237-7c06-4b87-98d7-b96b64e52281', '51428b7e-725e-4235-b072-bc0db1230487', '29f75bb6-f8f7-4c46-a8d0-4e5f02382be7'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:02 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f1eb3d1a-d17e-4b2c-a44e-23538a8b6d87 tempest-GroupSnapshotsTest-17303575 None] group_snapshot 8b775be7-9ec2-48b0-9e58-200fc59fa479: deleted successfully
Apr 15 23:19:03 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f" returned: 0 in 0.823s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1181206272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361b876d-eafa-4103-a4cc-9ef5ffce794d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928c14ee1ad24ffb80972d12b143cd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:01Z,use_quota=True,user_id='7d30e0144ccd490588d24f23127555d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Creating volume 361b876d-eafa-4103-a4cc-9ef5ffce794d {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:03 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:03 devstack sudo[84167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d 1073741824
Apr 15 23:19:03 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd66f267-0a85-47bb-b32f-7d2db8747181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318d4485-c657-4f22-8aed-107ae573d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:03 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Volume volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f (60cdaca6-d4c8-4984-8c9e-89ca0a57e56f): created successfully
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318d4485-c657-4f22-8aed-107ae573d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Flow 'volume_create_manager' (e53f3089-c0ea-4115-9436-983f8db50056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-ac27328a-a3ea-4ec2-981d-3ba2585618c1 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Created volume successfully.
Apr 15 23:19:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "cinder-quobyte-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" acquired by "delete_volume" :: waited 0.027s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:04 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[34963d39-64a0-4bf3-bc6d-a966f56829be]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-52d6cfcd-5b5c-4735-8577-6bb245610155 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:04 devstack sudo[84180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba
Apr 15 23:19:04 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:04 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d 1073741824" returned: 0 in 1.675s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:05 devstack sudo[84185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d
Apr 15 23:19:05 devstack sudo[84185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:05 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" returned: 0 in 1.110s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:05 devstack sudo[84189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba
Apr 15 23:19:05 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:05 devstack sudo[84185]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d" returned: 0 in 0.908s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] <== create_volume: return (2623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.630s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-52d6cfcd-5b5c-4735-8577-6bb245610155 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.527s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464fc7be-cdb9-4b68-919f-a0b2d52c53e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361b876d-eafa-4103-a4cc-9ef5ffce794d', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3377fe3c-ace3-4b46-8aed-ff538d622f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edda541-32b0-4a12-910c-ac6e221110f1]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-52d6cfcd-5b5c-4735-8577-6bb245610155 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:05 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Volume volume-361b876d-eafa-4103-a4cc-9ef5ffce794d (361b876d-eafa-4103-a4cc-9ef5ffce794d): created successfully
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3377fe3c-ace3-4b46-8aed-ff538d622f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Flow 'volume_create_manager' (e3488c41-4460-40a6-a1b4-9bf65d6b56d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:05 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e85fe904-4ee6-4e31-a2b1-8cd7861c271f tempest-VolumesTransfersTest-1305993630 None] Created volume successfully.
Apr 15 23:19:06 devstack sudo[84205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f
Apr 15 23:19:06 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:06 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" returned: 0 in 1.041s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Lock "cinder-quobyte-fc02b2a3-d364-4e0d-b70e-26edc3fac7ba" released by "delete_volume" :: held 2.283s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Created reservations ['d0eac2df-8991-4a97-85f1-b0ac73f89c2a'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:06 devstack cinder-volume[81941]: WARNING cinder.quota [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-824835198 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-824835198, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Created reservations ['a47a4ee8-c0c2-4a34-b79c-fc2c474869e3', 'ce6011e1-b8e0-4793-9c24-1fc658acfd78', '32741796-9ce6-4d20-9c13-0c0de4372579', '06eae5ff-b70f-4b9d-b841-7c0e3b973bb0'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:06 devstack sudo[84243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:06 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:07 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-52d6cfcd-5b5c-4735-8577-6bb245610155 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f" returned: 0 in 1.170s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-52d6cfcd-5b5c-4735-8577-6bb245610155 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.215s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-52d6cfcd-5b5c-4735-8577-6bb245610155 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31', 'name': 'volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cba97f8-341b-4b68-b4d0-db7a65f4ad19', 'enforce_multipath': True} {{(pid=81941) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 23:19:07 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-dbfef10c-728e-48c9-847c-e4653db0d4ca req-52d6cfcd-5b5c-4735-8577-6bb245610155 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] attachment_update completed successfully.
Apr 15 23:19:07 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a002cf82-70ea-44e2-a626-69e57ddadccd tempest-VolumesTransfersTest-589024673 None] Transfer volume completed successfully.
Apr 15 23:19:07 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.908s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:07 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:07 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d828059c-b31c-4ff7-9815-89a9a7153b7f tempest-GroupSnapshotsTest-17303575 None] Delete group completed successfully.
Apr 15 23:19:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Acquiring lock "cinder-361b876d-eafa-4103-a4cc-9ef5ffce794d-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Lock "cinder-361b876d-eafa-4103-a4cc-9ef5ffce794d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Acquiring lock "cinder-quobyte-361b876d-eafa-4103-a4cc-9ef5ffce794d" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Lock "cinder-quobyte-361b876d-eafa-4103-a4cc-9ef5ffce794d" acquired by "delete_volume" :: waited 0.027s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:09 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[62222dfa-8463-4b87-b49d-f2cc08c06fe6]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:09 devstack sudo[84249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d
Apr 15 23:19:09 devstack sudo[84249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:09 devstack sudo[84249]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d" returned: 0 in 0.824s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:09 devstack sudo[84323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d
Apr 15 23:19:09 devstack sudo[84323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:10 devstack sudo[84323]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-361b876d-eafa-4103-a4cc-9ef5ffce794d" returned: 0 in 0.532s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Lock "cinder-quobyte-361b876d-eafa-4103-a4cc-9ef5ffce794d" released by "delete_volume" :: held 1.444s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Created reservations ['4e915116-d2c7-49b7-9356-fbe2139997f2', 'a90e08be-caac-4547-aaca-7f8ab053dc45', '5721e827-dec4-4e35-a803-f656cbe7bfba', 'b7824ec0-31ab-4de8-8e81-1c88ab11e205'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:10 devstack sudo[84332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:10 devstack sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:11 devstack sudo[84332]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.572s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Deleted volume successfully.
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-145c58eb-6c26-4a95-bff0-f587a9580e19 tempest-VolumesTransfersTest-1490309484 None] Lock "cinder-361b876d-eafa-4103-a4cc-9ef5ffce794d-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Flow 'volume_create_manager' (fa2ebc81-a279-4321-954e-9a72f12ab643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0511c60-d191-4809-a5e4-94e9f207a5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0511c60-d191-4809-a5e4-94e9f207a5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1901323804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e186569-861c-4019-b64a-5b5fa5085f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928c14ee1ad24ffb80972d12b143cd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:11Z,use_quota=True,user_id='7d30e0144ccd490588d24f23127555d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90736768-0e10-41c5-bac7-5dad42b5c633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90736768-0e10-41c5-bac7-5dad42b5c633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b99746-bdaf-4f18-8fa0-77260c1b491e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b99746-bdaf-4f18-8fa0-77260c1b491e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e186569-861c-4019-b64a-5b5fa5085f63', 'volume_name': 'volume-7e186569-861c-4019-b64a-5b5fa5085f63', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae48a0f-be95-4339-a4e9-2f86deec3258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae48a0f-be95-4339-a4e9-2f86deec3258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b27a143-f1da-41d5-8589-dfd9d2e2e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:11 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Volume 7e186569-861c-4019-b64a-5b5fa5085f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e186569-861c-4019-b64a-5b5fa5085f63', 'volume_size': 1}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1901323804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e186569-861c-4019-b64a-5b5fa5085f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928c14ee1ad24ffb80972d12b143cd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:11Z,use_quota=True,user_id='7d30e0144ccd490588d24f23127555d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Creating volume 7e186569-861c-4019-b64a-5b5fa5085f63 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:11 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:11 devstack sudo[84341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63 1073741824
Apr 15 23:19:11 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:12 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-419b918a-618e-44dd-a738-60b20336264b tempest-GroupSnapshotsV319Test-2127347522 None] Group tempest-GroupSnapshotsV319Test-Group-883215340: creating
Apr 15 23:19:12 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-419b918a-618e-44dd-a738-60b20336264b tempest-GroupSnapshotsV319Test-2127347522 None] Group tempest-GroupSnapshotsV319Test-Group-883215340: created successfully
Apr 15 23:19:12 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-419b918a-618e-44dd-a738-60b20336264b tempest-GroupSnapshotsV319Test-2127347522 None] Create group completed successfully.
Apr 15 23:19:12 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63 1073741824" returned: 0 in 1.227s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:12 devstack sudo[84684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63
Apr 15 23:19:12 devstack sudo[84684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:13 devstack sudo[84684]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63" returned: 0 in 0.458s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:13 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b27a143-f1da-41d5-8589-dfd9d2e2e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e186569-861c-4019-b64a-5b5fa5085f63', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c6508a-021e-4630-b35d-fffde90d7ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:13 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Volume volume-7e186569-861c-4019-b64a-5b5fa5085f63 (7e186569-861c-4019-b64a-5b5fa5085f63): created successfully
Apr 15 23:19:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c6508a-021e-4630-b35d-fffde90d7ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Flow 'volume_create_manager' (fa2ebc81-a279-4321-954e-9a72f12ab643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:13 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2474d1f0-3011-42df-a2aa-e9183a730957 tempest-VolumesTransfersTest-1305993630 None] Created volume successfully.
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Flow 'volume_create_manager' (b60abd33-5ec7-42e8-8a78-523ff02363fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad9f8e6-e28f-4a78-b788-eacf9e9df0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Acquiring lock "cinder-7e186569-861c-4019-b64a-5b5fa5085f63-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad9f8e6-e28f-4a78-b788-eacf9e9df0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-114611162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a56087e7-7f3d-481c-93e4-77904cd299cc,host='devstack@QuobyteHD#QuobyteHD',id=3fc87251-70d2-489b-ac8e-06f5fc5f8e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0075da083ff4dd587faa3394cac76eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:14Z,use_quota=True,user_id='c5bc0e0a798844dfbf5f38585c1bffe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12cd5e77-8abc-4af7-9faf-41c91509afaf),volume_type_id=12cd5e77-8abc-4af7-9faf-41c91509afaf)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e9aba4-2206-4c70-be87-bd49c9401b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e9aba4-2206-4c70-be87-bd49c9401b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af83ad64-465d-4cd4-b077-f9bcab9d90cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af83ad64-465d-4cd4-b077-f9bcab9d90cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc87251-70d2-489b-ac8e-06f5fc5f8e07', 'volume_name': 'volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb6c3b8-2f66-44ec-b81d-c5a9388a9416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb6c3b8-2f66-44ec-b81d-c5a9388a9416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b288011-c80d-41ae-8c07-40b530367531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Volume 3fc87251-70d2-489b-ac8e-06f5fc5f8e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07', 'volume_size': 1}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a56087e7-7f3d-481c-93e4-77904cd299cc,created_at=2026-04-15T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-114611162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a56087e7-7f3d-481c-93e4-77904cd299cc,host='devstack@QuobyteHD#QuobyteHD',id=3fc87251-70d2-489b-ac8e-06f5fc5f8e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0075da083ff4dd587faa3394cac76eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:14Z,use_quota=True,user_id='c5bc0e0a798844dfbf5f38585c1bffe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12cd5e77-8abc-4af7-9faf-41c91509afaf),volume_type_id=12cd5e77-8abc-4af7-9faf-41c91509afaf)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Creating volume 3fc87251-70d2-489b-ac8e-06f5fc5f8e07 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:14 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Lock "cinder-7e186569-861c-4019-b64a-5b5fa5085f63-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:14 devstack sudo[84690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 1073741824
Apr 15 23:19:14 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Acquiring lock "cinder-quobyte-7e186569-861c-4019-b64a-5b5fa5085f63" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Lock "cinder-quobyte-7e186569-861c-4019-b64a-5b5fa5085f63" acquired by "delete_volume" :: waited 0.019s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[778a9238-3fb9-4e74-9e9b-ce85136fc126]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:14 devstack sudo[84692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63
Apr 15 23:19:14 devstack sudo[84692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Flow 'volume_create_manager' (962f0bf2-8101-410a-b4e1-fa11ae2af22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ed5afd-8c3d-4f73-99e4-ca7e29f3d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ed5afd-8c3d-4f73-99e4-ca7e29f3d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-263044008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e686102f-9626-403f-a88c-6c034ecef4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab209268501b4aa1b0ce0c9486676f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:15Z,use_quota=True,user_id='a79774f847e54431a7fe85e28457a1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3080fc-fd24-41c9-9742-3ec0a582c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3080fc-fd24-41c9-9742-3ec0a582c39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b24e2ec-2746-4791-984d-8833b4a343bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b24e2ec-2746-4791-984d-8833b4a343bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e686102f-9626-403f-a88c-6c034ecef4fb', 'volume_name': 'volume-e686102f-9626-403f-a88c-6c034ecef4fb', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3df880-07dc-4a30-bcfa-d799d252799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3df880-07dc-4a30-bcfa-d799d252799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3aeb2b-1192-48eb-9467-dc2d616e94cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:14 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Volume e686102f-9626-403f-a88c-6c034ecef4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e686102f-9626-403f-a88c-6c034ecef4fb', 'volume_size': 1}
Apr 15 23:19:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:15 devstack sudo[84692]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63" returned: 0 in 0.829s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:15 devstack sudo[84701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63
Apr 15 23:19:15 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:15 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 1073741824" returned: 0 in 1.116s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:15 devstack sudo[84704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07
Apr 15 23:19:15 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:16 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e186569-861c-4019-b64a-5b5fa5085f63" returned: 0 in 0.827s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Lock "cinder-quobyte-7e186569-861c-4019-b64a-5b5fa5085f63" released by "delete_volume" :: held 1.728s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Created reservations ['04dde279-b6c2-496b-bc02-f2c1fa00235f', 'a391ea1a-0ad4-4a41-b623-7725319d34d4', '7a5e873d-b441-40f5-9eb9-073859571eb2', 'feec2212-622d-48e5-8de6-10e77a0eb10e'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:16 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" returned: 0 in 0.767s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.107s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-263044008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e686102f-9626-403f-a88c-6c034ecef4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab209268501b4aa1b0ce0c9486676f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:15Z,use_quota=True,user_id='a79774f847e54431a7fe85e28457a1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Creating volume e686102f-9626-403f-a88c-6c034ecef4fb {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:16 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b288011-c80d-41ae-8c07-40b530367531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c41b72f-1cd7-4334-aa43-2fcd9906496e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:16 devstack sudo[84708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb 1073741824
Apr 15 23:19:16 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:16 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Volume volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 (3fc87251-70d2-489b-ac8e-06f5fc5f8e07): created successfully
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c41b72f-1cd7-4334-aa43-2fcd9906496e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Flow 'volume_create_manager' (b60abd33-5ec7-42e8-8a78-523ff02363fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:16 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cc5bb3ad-66b0-47aa-a4ff-8458e2d5edbe tempest-GroupSnapshotsV319Test-2127347522 None] Created volume successfully.
Apr 15 23:19:16 devstack sudo[84711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:16 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:16 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] GroupSnapshot 8d827de4-b71a-41bf-a209-f45f4d3b03e4: creating.
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Group snapshot 8d827de4-b71a-41bf-a209-f45f4d3b03e4: creating. {{(pid=81941) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 23:19:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:17 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.802s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Deleted volume successfully.
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2cb6dc72-591e-4bb1-84b8-8000c646b201 tempest-VolumesTransfersTest-1490309484 None] Lock "cinder-7e186569-861c-4019-b64a-5b5fa5085f63-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:17 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb 1073741824" returned: 0 in 1.073s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:17 devstack sudo[84717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb
Apr 15 23:19:17 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:17 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb" returned: 0 in 0.468s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.805s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3aeb2b-1192-48eb-9467-dc2d616e94cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e686102f-9626-403f-a88c-6c034ecef4fb', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c44c325-78a3-4fd3-b239-1e1058c788f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Creating offline snapshot 7f57993b-d902-4378-a264-70ed6fd35dd1 of volume 3fc87251-70d2-489b-ac8e-06f5fc5f8e07 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:19:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Volume volume-e686102f-9626-403f-a88c-6c034ecef4fb (e686102f-9626-403f-a88c-6c034ecef4fb): created successfully
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c44c325-78a3-4fd3-b239-1e1058c788f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Flow 'volume_create_manager' (962f0bf2-8101-410a-b4e1-fa11ae2af22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6afe0ea-2f1e-4e69-9773-32cf2c4393b9]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8a6a1655-9e2e-482b-aa63-9520f435571a tempest-ServersNegativeTestJSON-949947024 None] Created volume successfully.
Apr 15 23:19:17 devstack sudo[84720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07
Apr 15 23:19:17 devstack sudo[84720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:18 devstack sudo[84720]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" returned: 0 in 0.646s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:18 devstack sudo[84725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 1G
Apr 15 23:19:18 devstack sudo[84725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:19 devstack sudo[84725]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 1G" returned: 0 in 0.649s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:19 devstack sudo[84730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1
Apr 15 23:19:19 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Flow 'volume_create_manager' (58799bae-3cdd-42c8-8424-71214836f3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4bc9d6-372d-43e7-8fdd-318a96096c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4bc9d6-372d-43e7-8fdd-318a96096c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-139932345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d1314b-82e0-4e93-bd3a-99314bff25be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab209268501b4aa1b0ce0c9486676f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:19Z,use_quota=True,user_id='a79774f847e54431a7fe85e28457a1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217d561e-c7c8-4048-90b6-ffdd417f1ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217d561e-c7c8-4048-90b6-ffdd417f1ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c083f1dd-4ba8-458b-99d7-f3622e7b3c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c083f1dd-4ba8-458b-99d7-f3622e7b3c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d1314b-82e0-4e93-bd3a-99314bff25be', 'volume_name': 'volume-20d1314b-82e0-4e93-bd3a-99314bff25be', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be369ad-ffb1-441f-b760-b8d9dc34afdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be369ad-ffb1-441f-b760-b8d9dc34afdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7044185b-a243-4b7f-8679-c09af04e0cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:19 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Volume 20d1314b-82e0-4e93-bd3a-99314bff25be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d1314b-82e0-4e93-bd3a-99314bff25be', 'volume_size': 1}
Apr 15 23:19:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:20 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1" returned: 0 in 0.958s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:20 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:19:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:20 devstack sudo[84757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1
Apr 15 23:19:20 devstack sudo[84757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:20 devstack sudo[84757]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1" returned: 0 in 0.493s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:20 devstack sudo[84760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.info
Apr 15 23:19:20 devstack sudo[84760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:21 devstack sudo[84760]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.info" returned: 0 in 0.705s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:21 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:21 devstack sudo[84769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.info
Apr 15 23:19:21 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:21 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.info" returned: 0 in 0.444s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.994s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.291s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-139932345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d1314b-82e0-4e93-bd3a-99314bff25be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab209268501b4aa1b0ce0c9486676f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:19Z,use_quota=True,user_id='a79774f847e54431a7fe85e28457a1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Creating volume 20d1314b-82e0-4e93-bd3a-99314bff25be {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:21 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:21 devstack sudo[84783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be 1073741824
Apr 15 23:19:21 devstack sudo[84783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:21 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0c96ab27-84fe-4609-827e-c693a75a2750 tempest-GroupSnapshotsV319Test-2127347522 None] group_snapshot 8d827de4-b71a-41bf-a209-f45f4d3b03e4: created successfully
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Flow 'volume_create_manager' (d1098895-e1eb-4643-9108-a65e24f985fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e032ea0-a582-4a65-8363-9d8c27813f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e032ea0-a582-4a65-8363-9d8c27813f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2033134755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e79dd4-8db2-499f-9800-608429ad8dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9187be73ca5a461caad50ab90abc4e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:22Z,use_quota=True,user_id='cd577832c01a4297b03f74bbe3083479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc4bc42-1f6e-4392-a53d-6c968901c45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc4bc42-1f6e-4392-a53d-6c968901c45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37638431-78be-47bd-9cc5-44c513cc957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37638431-78be-47bd-9cc5-44c513cc957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e79dd4-8db2-499f-9800-608429ad8dca', 'volume_name': 'volume-23e79dd4-8db2-499f-9800-608429ad8dca', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaafac03-360c-41cb-a9c3-c8285926f39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaafac03-360c-41cb-a9c3-c8285926f39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a63491c-f16c-425f-bf4c-c631ffc20fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:21 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Volume 23e79dd4-8db2-499f-9800-608429ad8dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e79dd4-8db2-499f-9800-608429ad8dca', 'volume_size': 1}
Apr 15 23:19:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:22 devstack sudo[84783]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be 1073741824" returned: 0 in 0.575s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:22 devstack sudo[84788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be
Apr 15 23:19:22 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:22 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] group_snapshot 8d827de4-b71a-41bf-a209-f45f4d3b03e4: deleting
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] group_snapshot 8d827de4-b71a-41bf-a209-f45f4d3b03e4: deleting {{(pid=81941) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Acquiring lock "cinder-quobyte-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Lock "cinder-quobyte-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Acquiring lock "cinder-quobyte-7f57993b-d902-4378-a264-70ed6fd35dd1" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Lock "cinder-quobyte-7f57993b-d902-4378-a264-70ed6fd35dd1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Deleting offline snapshot 7f57993b-d902-4378-a264-70ed6fd35dd1 of volume 3fc87251-70d2-489b-ac8e-06f5fc5f8e07 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] snapshot_file for this snap is: volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe8152-b956-453b-bab7-b75950dd1ba9]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:22 devstack sudo[84790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1
Apr 15 23:19:22 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:22 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be" returned: 0 in 0.547s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2033134755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e79dd4-8db2-499f-9800-608429ad8dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9187be73ca5a461caad50ab90abc4e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:22Z,use_quota=True,user_id='cd577832c01a4297b03f74bbe3083479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Creating volume 23e79dd4-8db2-499f-9800-608429ad8dca {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:22 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7044185b-a243-4b7f-8679-c09af04e0cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d1314b-82e0-4e93-bd3a-99314bff25be', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8095dfee-eaf4-4ed2-86b1-ab763aa578b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:22 devstack sudo[84793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca 1073741824
Apr 15 23:19:22 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:22 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Volume volume-20d1314b-82e0-4e93-bd3a-99314bff25be (20d1314b-82e0-4e93-bd3a-99314bff25be): created successfully
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8095dfee-eaf4-4ed2-86b1-ab763aa578b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Flow 'volume_create_manager' (58799bae-3cdd-42c8-8424-71214836f3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:22 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-307f4d99-d05e-4647-bf18-f9d49274d67f tempest-ServersNegativeTestJSON-949947024 None] Created volume successfully.
Apr 15 23:19:23 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1" returned: 0 in 0.494s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a850403-340a-4fc9-b900-e3516edc9139]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:23 devstack sudo[84798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07
Apr 15 23:19:23 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:23 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca 1073741824" returned: 0 in 0.539s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:23 devstack sudo[84803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca
Apr 15 23:19:23 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:23 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" returned: 0 in 0.561s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:23 devstack sudo[84808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1
Apr 15 23:19:23 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:23 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca" returned: 0 in 0.462s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a63491c-f16c-425f-bf4c-c631ffc20fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e79dd4-8db2-499f-9800-608429ad8dca', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd023ff-8d7c-4ed5-a13e-285b4f02686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:23 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Volume volume-23e79dd4-8db2-499f-9800-608429ad8dca (23e79dd4-8db2-499f-9800-608429ad8dca): created successfully
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd023ff-8d7c-4ed5-a13e-285b4f02686b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Flow 'volume_create_manager' (d1098895-e1eb-4643-9108-a65e24f985fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:23 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-44eec164-b530-4816-ae6a-1546500d22fe tempest-VolumesTransfersV355Test-1865793827 None] Created volume successfully.
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "cinder-20d1314b-82e0-4e93-bd3a-99314bff25be-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Lock "cinder-20d1314b-82e0-4e93-bd3a-99314bff25be-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "cinder-quobyte-20d1314b-82e0-4e93-bd3a-99314bff25be" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Lock "cinder-quobyte-20d1314b-82e0-4e93-bd3a-99314bff25be" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8888d148-8b24-4b7f-bdcc-5ce922bf9ecd]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:24 devstack sudo[84814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be
Apr 15 23:19:24 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:24 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1" returned: 0 in 0.501s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:24 devstack sudo[84817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1
Apr 15 23:19:24 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:24 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be" returned: 0 in 0.510s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:24 devstack sudo[84823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be
Apr 15 23:19:24 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:24 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07.7f57993b-d902-4378-a264-70ed6fd35dd1" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Lock "cinder-quobyte-7f57993b-d902-4378-a264-70ed6fd35dd1" released by "_delete_snapshot" :: held 2.079s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Lock "cinder-quobyte-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" released by "delete_snapshot" :: held 2.092s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:24 devstack cinder-volume[81941]: WARNING cinder.quota [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-984672621 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-984672621, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:19:24 devstack cinder-volume[81941]: WARNING cinder.quota [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-984672621 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-984672621, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] Created reservations ['fe3e0237-8bc9-44e9-bcc1-7fb9de88cf05', 'f78ca84c-947e-49df-bb78-e543343e26ca', 'f260aa9b-2f54-407f-ae34-6fc920d8512f', 'de890a61-ed95-4a1a-902b-707fb2046466'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:24 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-93a2195a-6fd7-4440-8016-d3854d1432d5 tempest-GroupSnapshotsV319Test-2127347522 None] group_snapshot 8d827de4-b71a-41bf-a209-f45f4d3b03e4: deleted successfully
Apr 15 23:19:24 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-20d1314b-82e0-4e93-bd3a-99314bff25be" returned: 0 in 0.422s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Lock "cinder-quobyte-20d1314b-82e0-4e93-bd3a-99314bff25be" released by "delete_volume" :: held 0.954s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:24 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Created reservations ['551c3295-1e0b-4024-8072-ca6b0c809e27', 'e01f55dc-b1c4-4452-8c90-73939a239f21', '65aef196-6341-4fc0-93f5-3af9a667ff86', '1888f1ac-7cf0-4bab-86d4-a867fa7fbb61'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:25 devstack sudo[84826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:25 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "cinder-e686102f-9626-403f-a88c-6c034ecef4fb-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Lock "cinder-e686102f-9626-403f-a88c-6c034ecef4fb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "cinder-quobyte-e686102f-9626-403f-a88c-6c034ecef4fb" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Lock "cinder-quobyte-e686102f-9626-403f-a88c-6c034ecef4fb" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[69616f9e-0329-4b51-902a-d5a21e6b31b4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:25 devstack sudo[84828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb
Apr 15 23:19:25 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:25 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d257a991-9ecf-4eaf-89d1-aa95080638ea tempest-VolumesTransfersV355Test-774153429 None] Transfer volume completed successfully.
Apr 15 23:19:25 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:25 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Deleted volume successfully.
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-24fd34f6-af59-4d7c-b578-3639c02fa1a3 tempest-ServersNegativeTestJSON-949947024 None] Lock "cinder-20d1314b-82e0-4e93-bd3a-99314bff25be-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:25 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb" returned: 0 in 0.612s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:25 devstack sudo[84860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb
Apr 15 23:19:25 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Acquiring lock "cinder-quobyte-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Lock "cinder-quobyte-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" acquired by "delete_volume" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9cfbb2-842e-4d99-afba-1752d14a0af7]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:26 devstack sudo[84864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07
Apr 15 23:19:26 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Acquiring lock "cinder-23e79dd4-8db2-499f-9800-608429ad8dca-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Lock "cinder-23e79dd4-8db2-499f-9800-608429ad8dca-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Acquiring lock "cinder-quobyte-23e79dd4-8db2-499f-9800-608429ad8dca" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Lock "cinder-quobyte-23e79dd4-8db2-499f-9800-608429ad8dca" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb1f80a-b71b-4d44-83fc-39f43e6048f4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:26 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e686102f-9626-403f-a88c-6c034ecef4fb" returned: 0 in 0.784s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Lock "cinder-quobyte-e686102f-9626-403f-a88c-6c034ecef4fb" released by "delete_volume" :: held 1.423s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Created reservations ['8a139791-6ba2-4d2b-8aa8-ff2d2f90987d', '84030c62-cf42-4e91-bd82-0cb91aaaca66', '2ce43e73-ca33-469e-ae88-b321c0c42f1d', 'e6fdce87-1671-4473-ba8f-5b2d5c6ff5e4'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:26 devstack sudo[84869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca
Apr 15 23:19:26 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:26 devstack sudo[84871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:26 devstack sudo[84871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:26 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" returned: 0 in 0.776s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:26 devstack sudo[84876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07
Apr 15 23:19:26 devstack sudo[84876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:27 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca" returned: 0 in 0.678s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:27 devstack sudo[84882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca
Apr 15 23:19:27 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:27 devstack sudo[84876]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" returned: 0 in 0.506s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Lock "cinder-quobyte-3fc87251-70d2-489b-ac8e-06f5fc5f8e07" released by "delete_volume" :: held 1.337s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Created reservations ['4474b37f-39d8-4598-a9c7-73a60025526f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:27 devstack cinder-volume[81941]: WARNING cinder.quota [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-984672621 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-984672621, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Created reservations ['12a83f1e-7edc-43fa-a643-d908315cb9a2', 'a80e5150-8877-4e17-9414-eba0e743cfc6', '0afc1ac7-c366-44b4-aa8c-f1466efd3aca', '7842a207-f8ac-40d5-8100-c6324dcdb02b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:27 devstack sudo[84871]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.892s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:27 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Deleted volume successfully.
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10d96b95-81c5-4714-aeee-6e4470d22c74 tempest-ServersNegativeTestJSON-949947024 None] Lock "cinder-e686102f-9626-403f-a88c-6c034ecef4fb-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:27 devstack sudo[84887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:27 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:27 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-23e79dd4-8db2-499f-9800-608429ad8dca" returned: 0 in 0.581s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Lock "cinder-quobyte-23e79dd4-8db2-499f-9800-608429ad8dca" released by "delete_volume" :: held 1.295s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Created reservations ['d8232194-ea7f-43b0-a423-7871b7838fa5', '5d0f1fcc-d8bc-42d3-92db-fe175d2ffd01', '33d799dd-cd48-4205-a322-bfa304fa588f', '304cd04e-22ff-4d1e-89eb-8b28e3f3fd11'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:27 devstack sudo[84890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:27 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:28 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.564s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:28 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f187f95b-6fb2-4a88-8afa-aa94ac52d7da tempest-GroupSnapshotsV319Test-2127347522 None] Delete group completed successfully.
Apr 15 23:19:28 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.470s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:28 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Deleted volume successfully.
Apr 15 23:19:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-de1138a2-6cfc-4daa-b419-491b0ec9ac6a tempest-VolumesTransfersV355Test-505040944 None] Lock "cinder-23e79dd4-8db2-499f-9800-608429ad8dca-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Flow 'volume_create_manager' (cd8d7c02-6289-422c-ba25-ace12d0fceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198c36fb-c1a0-43dd-9273-1a571f439dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198c36fb-c1a0-43dd-9273-1a571f439dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-454645253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b29a72-1bb8-4f5d-b46b-483d902a09c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9187be73ca5a461caad50ab90abc4e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:29Z,use_quota=True,user_id='cd577832c01a4297b03f74bbe3083479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ffbefd-c478-45ce-b58b-305c1f6d13bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ffbefd-c478-45ce-b58b-305c1f6d13bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb11bb86-dd71-417d-a49a-e2d1d98df98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb11bb86-dd71-417d-a49a-e2d1d98df98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b29a72-1bb8-4f5d-b46b-483d902a09c9', 'volume_name': 'volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b7f21f-1ef7-4717-80da-41e928c6cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b7f21f-1ef7-4717-80da-41e928c6cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f515446-9378-482f-ae1b-0cd04e503793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:29 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Volume 54b29a72-1bb8-4f5d-b46b-483d902a09c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9', 'volume_size': 1}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-454645253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b29a72-1bb8-4f5d-b46b-483d902a09c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9187be73ca5a461caad50ab90abc4e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:29Z,use_quota=True,user_id='cd577832c01a4297b03f74bbe3083479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Creating volume 54b29a72-1bb8-4f5d-b46b-483d902a09c9 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:29 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:29 devstack sudo[84942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9 1073741824
Apr 15 23:19:29 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:30 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9 1073741824" returned: 0 in 0.714s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:30 devstack sudo[84953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9
Apr 15 23:19:30 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:30 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9" returned: 0 in 0.560s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=158,cinder:UPDATE=189,cinder:INSERT=42,cinder:DELETE=7 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f515446-9378-482f-ae1b-0cd04e503793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfab5cc-51ae-4f14-9ca2-ae34fe1bf987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:30 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Volume volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9 (54b29a72-1bb8-4f5d-b46b-483d902a09c9): created successfully
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfab5cc-51ae-4f14-9ca2-ae34fe1bf987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Flow 'volume_create_manager' (cd8d7c02-6289-422c-ba25-ace12d0fceb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:30 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c8927182-e35f-4e70-932e-a503452853e2 tempest-VolumesTransfersV355Test-1865793827 None] Created volume successfully.
Apr 15 23:19:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Acquiring lock "cinder-54b29a72-1bb8-4f5d-b46b-483d902a09c9-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Lock "cinder-54b29a72-1bb8-4f5d-b46b-483d902a09c9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Acquiring lock "cinder-quobyte-54b29a72-1bb8-4f5d-b46b-483d902a09c9" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Lock "cinder-quobyte-54b29a72-1bb8-4f5d-b46b-483d902a09c9" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:31 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bbd88d-3408-407a-86df-868c0c50196b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:31 devstack sudo[85002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9
Apr 15 23:19:31 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:32 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9" returned: 0 in 0.554s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:32 devstack sudo[85013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9
Apr 15 23:19:32 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:32 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-54b29a72-1bb8-4f5d-b46b-483d902a09c9" returned: 0 in 0.535s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Lock "cinder-quobyte-54b29a72-1bb8-4f5d-b46b-483d902a09c9" released by "delete_volume" :: held 1.116s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Created reservations ['594a2884-8f79-4498-9c11-3f1b8a231ca6', 'f38932bf-0d22-4d5d-ad48-b7d3ccd186fb', '4331ab58-76a8-4171-a537-f7addbf0648a', '5b4fa8e5-2fcc-4acf-85c9-f7d93e5b846c'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:32 devstack sudo[85017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:32 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:33 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.570s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:33 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Deleted volume successfully.
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d1a8b9d-b1ca-4d62-a650-39169865e86d tempest-VolumesTransfersV355Test-505040944 None] Lock "cinder-54b29a72-1bb8-4f5d-b46b-483d902a09c9-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Flow 'volume_create_manager' (2b6b416c-2aaf-4097-b1a7-c67a787a34f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f276e01-8514-4692-a98a-afb3339726f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f276e01-8514-4692-a98a-afb3339726f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1329716000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366b6e7b-1900-4b5c-be93-53df139a5030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9cca2c419147cd819a3c1a5f9d4447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:34Z,use_quota=True,user_id='2b266f063b724188945791c9126db020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c30db38-b818-41cb-8047-2fe9290ab6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c30db38-b818-41cb-8047-2fe9290ab6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3374d56-4caf-4989-815b-739ffa2d1225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3374d56-4caf-4989-815b-739ffa2d1225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '366b6e7b-1900-4b5c-be93-53df139a5030', 'volume_name': 'volume-366b6e7b-1900-4b5c-be93-53df139a5030', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce67a56-a0b8-4ac4-af5d-a684a74c4227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce67a56-a0b8-4ac4-af5d-a684a74c4227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600db0b6-6f14-4252-9978-6574069c44df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:33 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Volume 366b6e7b-1900-4b5c-be93-53df139a5030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-366b6e7b-1900-4b5c-be93-53df139a5030', 'volume_size': 1}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1329716000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366b6e7b-1900-4b5c-be93-53df139a5030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9cca2c419147cd819a3c1a5f9d4447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:34Z,use_quota=True,user_id='2b266f063b724188945791c9126db020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Creating volume 366b6e7b-1900-4b5c-be93-53df139a5030 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:33 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:34 devstack sudo[85026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030 1073741824
Apr 15 23:19:34 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:34 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030 1073741824" returned: 0 in 0.668s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:34 devstack sudo[85031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030
Apr 15 23:19:34 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:35 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030" returned: 0 in 0.614s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600db0b6-6f14-4252-9978-6574069c44df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366b6e7b-1900-4b5c-be93-53df139a5030', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176602b9-04bd-4ac5-923c-f924d44ed816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:35 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Volume volume-366b6e7b-1900-4b5c-be93-53df139a5030 (366b6e7b-1900-4b5c-be93-53df139a5030): created successfully
Apr 15 23:19:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176602b9-04bd-4ac5-923c-f924d44ed816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Flow 'volume_create_manager' (2b6b416c-2aaf-4097-b1a7-c67a787a34f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1b0649af-e7e5-474c-bfbc-15199382e422 tempest-VolumeQuotasAdminTestJSON-1653149377 None] Created volume successfully.
Apr 15 23:19:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Acquiring lock "cinder-366b6e7b-1900-4b5c-be93-53df139a5030-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "cinder-366b6e7b-1900-4b5c-be93-53df139a5030-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Acquiring lock "cinder-quobyte-366b6e7b-1900-4b5c-be93-53df139a5030" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "cinder-quobyte-366b6e7b-1900-4b5c-be93-53df139a5030" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:36 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e0b6df-44ca-46e8-8aba-feef6774b90c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:36 devstack sudo[85036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030
Apr 15 23:19:36 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:36 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030" returned: 0 in 0.632s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:36 devstack sudo[85041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030
Apr 15 23:19:36 devstack sudo[85041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:37 devstack sudo[85041]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-366b6e7b-1900-4b5c-be93-53df139a5030" returned: 0 in 0.550s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "cinder-quobyte-366b6e7b-1900-4b5c-be93-53df139a5030" released by "delete_volume" :: held 1.219s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Created reservations ['892df563-9c5e-4d38-9077-bb7b4df4e1d0', 'cbba75d5-f7f6-4326-a5f9-3269513c6a80', '7c71144f-8470-4256-9fd9-10a9d515e347', '3b693393-2d37-4d86-af67-d4a2d941d47b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:37 devstack sudo[85044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:37 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:38 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.685s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Deleted volume successfully.
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-47c6d03c-5e22-4516-9c30-5143b4d96e7d tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "cinder-366b6e7b-1900-4b5c-be93-53df139a5030-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Flow 'volume_create_manager' (03bbe2d1-6e1e-4fe2-bcad-2e666a411eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44bc29f-0ec4-41fa-a6ed-1449d52989fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44bc29f-0ec4-41fa-a6ed-1449d52989fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1291720055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb82d510-001a-49a6-9418-55f2071510af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9cca2c419147cd819a3c1a5f9d4447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:39Z,use_quota=True,user_id='2b266f063b724188945791c9126db020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07eba390-31aa-429c-917f-a55178d34b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07eba390-31aa-429c-917f-a55178d34b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998e2c25-28d6-46a2-9397-7116cee18f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998e2c25-28d6-46a2-9397-7116cee18f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb82d510-001a-49a6-9418-55f2071510af', 'volume_name': 'volume-cb82d510-001a-49a6-9418-55f2071510af', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e088a6-ab31-4c3c-a24e-60e58c39d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e088a6-ab31-4c3c-a24e-60e58c39d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc17010-7185-428b-88b4-7913daf3de46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:38 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Volume cb82d510-001a-49a6-9418-55f2071510af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb82d510-001a-49a6-9418-55f2071510af', 'volume_size': 1}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1291720055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb82d510-001a-49a6-9418-55f2071510af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9cca2c419147cd819a3c1a5f9d4447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:39Z,use_quota=True,user_id='2b266f063b724188945791c9126db020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Creating volume cb82d510-001a-49a6-9418-55f2071510af {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:38 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:38 devstack sudo[85048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af 1073741824
Apr 15 23:19:38 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Flow 'volume_create_manager' (71af2662-272b-4e07-a9f7-1161ffcb7835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60a38c4-bf6c-40bd-9263-08623fcb3b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60a38c4-bf6c-40bd-9263-08623fcb3b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-644959917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0856fc-13fe-423c-a9b9-bfc4aa261545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5dfe8e70144f78b66e9969267f2263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:40Z,use_quota=True,user_id='76c2e00953e744b8a3b1a1b63ca3b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0463fb80-255f-40a3-a987-f633e97f1a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0463fb80-255f-40a3-a987-f633e97f1a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c3258d-78a7-4b01-b315-62d94f04af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c3258d-78a7-4b01-b315-62d94f04af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0856fc-13fe-423c-a9b9-bfc4aa261545', 'volume_name': 'volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29228940-2263-4754-aa10-fa031f24a96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29228940-2263-4754-aa10-fa031f24a96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163f661e-3e42-4c4e-bdb9-f89b66e08971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:39 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Volume 8a0856fc-13fe-423c-a9b9-bfc4aa261545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545', 'volume_size': 1}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:39 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af 1073741824" returned: 0 in 0.849s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:39 devstack sudo[85065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af
Apr 15 23:19:39 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:40 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af" returned: 0 in 0.442s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.550s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-644959917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0856fc-13fe-423c-a9b9-bfc4aa261545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5dfe8e70144f78b66e9969267f2263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:40Z,use_quota=True,user_id='76c2e00953e744b8a3b1a1b63ca3b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Creating volume 8a0856fc-13fe-423c-a9b9-bfc4aa261545 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:40 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc17010-7185-428b-88b4-7913daf3de46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb82d510-001a-49a6-9418-55f2071510af', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54db128-ef29-4e40-8bf6-a331431c39d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:40 devstack sudo[85073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545 1073741824
Apr 15 23:19:40 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:40 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Volume volume-cb82d510-001a-49a6-9418-55f2071510af (cb82d510-001a-49a6-9418-55f2071510af): created successfully
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54db128-ef29-4e40-8bf6-a331431c39d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Flow 'volume_create_manager' (03bbe2d1-6e1e-4fe2-bcad-2e666a411eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0f54ed71-045d-4644-b254-d42ef5f4ad5e tempest-VolumeQuotasAdminTestJSON-1653149377 None] Created volume successfully.
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Flow 'volume_create_manager' (08e38f02-9468-49d3-b8a8-6bee6fa24ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564bc975-d777-486e-a413-eba3a58ca93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564bc975-d777-486e-a413-eba3a58ca93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1812055267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f31b535-f4cc-4c2c-9819-eae7c4226f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd921ed7a9924916a421ee8768003cc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:40Z,use_quota=True,user_id='257f05611f8c40bb8c7d8a29367e352b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269a5ca0-2550-480b-8c08-18ca472513de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269a5ca0-2550-480b-8c08-18ca472513de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f41454d-5f03-4c31-8cd4-6eccbe098b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f41454d-5f03-4c31-8cd4-6eccbe098b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f31b535-f4cc-4c2c-9819-eae7c4226f7b', 'volume_name': 'volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b873174-c412-4be5-97b9-f1c4cca48344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b873174-c412-4be5-97b9-f1c4cca48344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71046214-6440-4dff-b159-3f0e1fc9859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:40 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Volume 0f31b535-f4cc-4c2c-9819-eae7c4226f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b', 'volume_size': 1}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:40 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545 1073741824" returned: 0 in 0.550s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:UPDATE=199,cinder:DELETE=16,cinder:SELECT=156,cinder:INSERT=48 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:19:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:40 devstack sudo[85078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545
Apr 15 23:19:40 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:41 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545" returned: 0 in 0.485s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1812055267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f31b535-f4cc-4c2c-9819-eae7c4226f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd921ed7a9924916a421ee8768003cc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:40Z,use_quota=True,user_id='257f05611f8c40bb8c7d8a29367e352b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Creating volume 0f31b535-f4cc-4c2c-9819-eae7c4226f7b {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:41 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163f661e-3e42-4c4e-bdb9-f89b66e08971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902e6b66-dacb-4202-9a54-49bc293f6b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:41 devstack sudo[85113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b 1073741824
Apr 15 23:19:41 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Volume volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545 (8a0856fc-13fe-423c-a9b9-bfc4aa261545): created successfully
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902e6b66-dacb-4202-9a54-49bc293f6b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Flow 'volume_create_manager' (71af2662-272b-4e07-a9f7-1161ffcb7835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-bedb9a53-a3ae-4790-bd99-575b756c860f tempest-VolumesTransfersV357Test-439346093 None] Created volume successfully.
Apr 15 23:19:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-bab8f941-7830-4e3c-9174-7682591c8698 tempest-VolumeQuotasAdminTestJSON-1095836335 None] Transfer volume completed successfully.
Apr 15 23:19:41 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b 1073741824" returned: 0 in 0.605s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:41 devstack sudo[85120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b
Apr 15 23:19:41 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:42 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-293d6509-cb1d-4f43-ad86-49612668c05b tempest-VolumesTransfersV357Test-1796546147 None] Transfer volume completed successfully.
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Acquiring lock "cinder-cb82d510-001a-49a6-9418-55f2071510af-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Lock "cinder-cb82d510-001a-49a6-9418-55f2071510af-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Acquiring lock "cinder-quobyte-cb82d510-001a-49a6-9418-55f2071510af" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Lock "cinder-quobyte-cb82d510-001a-49a6-9418-55f2071510af" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b12f9df-9ba5-46dd-8270-59a897dd89d7]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:42 devstack sudo[85122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af
Apr 15 23:19:42 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:42 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" returned: 0 in 0.415s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71046214-6440-4dff-b159-3f0e1fc9859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7315be12-3944-42b4-a398-9449d8aa5873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:42 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Volume volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b (0f31b535-f4cc-4c2c-9819-eae7c4226f7b): created successfully
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7315be12-3944-42b4-a398-9449d8aa5873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Flow 'volume_create_manager' (08e38f02-9468-49d3-b8a8-6bee6fa24ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:42 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-df547105-f479-48d1-b247-ce0362f51e35 req-2ad74700-e937-4e49-a45b-689480cbac37 tempest-VolumesSnapshotsTestJSON-2070856754 None] Created volume successfully.
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Creating offline snapshot 63049823-9dd9-4491-8ac9-480a0562aa72 of volume 0f31b535-f4cc-4c2c-9819-eae7c4226f7b {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[62acd45b-433a-4bd1-84a0-3c717ec93c0e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:42 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af" returned: 0 in 0.574s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:42 devstack sudo[85132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af
Apr 15 23:19:42 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:42 devstack sudo[85131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b
Apr 15 23:19:42 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Acquiring lock "cinder-8a0856fc-13fe-423c-a9b9-bfc4aa261545-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Lock "cinder-8a0856fc-13fe-423c-a9b9-bfc4aa261545-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Acquiring lock "cinder-quobyte-8a0856fc-13fe-423c-a9b9-bfc4aa261545" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Lock "cinder-quobyte-8a0856fc-13fe-423c-a9b9-bfc4aa261545" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[202bb653-b25d-41a1-a443-018faefb3ec5]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:43 devstack sudo[85135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545
Apr 15 23:19:43 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:43 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb82d510-001a-49a6-9418-55f2071510af" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Lock "cinder-quobyte-cb82d510-001a-49a6-9418-55f2071510af" released by "delete_volume" :: held 1.073s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Created reservations ['1bc67229-dbd7-4aa7-8424-1f9785940319', '9e6d4dbc-8af8-4fbd-b77f-fd8c11c18b8b', 'c267d74b-5f34-4bf2-b6b4-00410d35b997', 'a653d8c0-813d-4812-bca8-1f38dbfa388d'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:43 devstack sudo[85141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:43 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:43 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" returned: 0 in 0.625s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:43 devstack sudo[85143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 1G
Apr 15 23:19:43 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:43 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545" returned: 0 in 0.548s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:43 devstack sudo[85148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545
Apr 15 23:19:43 devstack sudo[85148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:43 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.432s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:43 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Deleted volume successfully.
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4516c0fd-9192-4416-acf8-29d0b4fa804d tempest-VolumeQuotasAdminTestJSON-2064871001 None] Lock "cinder-cb82d510-001a-49a6-9418-55f2071510af-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:43 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 1G" returned: 0 in 0.525s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:43 devstack sudo[85154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72
Apr 15 23:19:43 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:44 devstack sudo[85148]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8a0856fc-13fe-423c-a9b9-bfc4aa261545" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Lock "cinder-quobyte-8a0856fc-13fe-423c-a9b9-bfc4aa261545" released by "delete_volume" :: held 1.057s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Created reservations ['ef4acf23-00c5-49f8-8edd-e8af2994c767', 'a7767174-621d-4539-8efe-89f00751a150', '30588bc0-b543-487f-ab5e-67f7394e27e2', '1ef0b408-c21e-41a9-8b8c-3cc4bb6e03fe'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:44 devstack sudo[85182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:44 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:44 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72" returned: 0 in 0.636s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:44 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 is being set with open permissions: ugo+rw
Apr 15 23:19:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:44 devstack sudo[85189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72
Apr 15 23:19:44 devstack sudo[85189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:45 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 1.160s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:45 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Deleted volume successfully.
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eca9d6a3-775e-47ae-8f01-6c2113e809c5 tempest-VolumesTransfersV357Test-136578046 None] Lock "cinder-8a0856fc-13fe-423c-a9b9-bfc4aa261545-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:45 devstack sudo[85189]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Flow 'volume_create_manager' (5d27f8d3-36ca-4b81-b0b4-eb43cff09c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edd015a-22dc-4bb4-a7e8-71fe37bf2a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72" returned: 0 in 1.057s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edd015a-22dc-4bb4-a7e8-71fe37bf2a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1900481791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cafe4d-e175-42cf-9d74-8d089127238c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5dfe8e70144f78b66e9969267f2263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:45Z,use_quota=True,user_id='76c2e00953e744b8a3b1a1b63ca3b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422000ad-212b-4b58-a962-ae2885d12f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422000ad-212b-4b58-a962-ae2885d12f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526ca2ac-d98a-4801-8dd6-21bb95314db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526ca2ac-d98a-4801-8dd6-21bb95314db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22cafe4d-e175-42cf-9d74-8d089127238c', 'volume_name': 'volume-22cafe4d-e175-42cf-9d74-8d089127238c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d60365-1020-4185-8231-c2f98f91a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d60365-1020-4185-8231-c2f98f91a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603920d5-5f05-4a71-814f-62f7ad7cfd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:45 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Volume 22cafe4d-e175-42cf-9d74-8d089127238c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22cafe4d-e175-42cf-9d74-8d089127238c', 'volume_size': 1}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:45 devstack sudo[85196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.info
Apr 15 23:19:45 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:46 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.info" returned: 0 in 0.666s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:46 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.info is being set with open permissions: ugo+rw
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:46 devstack sudo[85206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.info
Apr 15 23:19:46 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:46 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.info" returned: 0 in 0.551s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.171s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.253s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1900481791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cafe4d-e175-42cf-9d74-8d089127238c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5dfe8e70144f78b66e9969267f2263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:45Z,use_quota=True,user_id='76c2e00953e744b8a3b1a1b63ca3b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Creating volume 22cafe4d-e175-42cf-9d74-8d089127238c {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:46 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:46 devstack sudo[85216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c 1073741824
Apr 15 23:19:46 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-c77185ab-348f-412c-9d6a-95c03eb8ef19 req-29588be7-b7e6-4ea3-91b3-041f71fcc7eb tempest-VolumesSnapshotsTestJSON-2070856754 None] Create snapshot completed successfully
Apr 15 23:19:46 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "cinder-63049823-9dd9-4491-8ac9-480a0562aa72-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-63049823-9dd9-4491-8ac9-480a0562aa72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "cinder-quobyte-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-quobyte-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "cinder-quobyte-63049823-9dd9-4491-8ac9-480a0562aa72" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-quobyte-63049823-9dd9-4491-8ac9-480a0562aa72" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Deleting offline snapshot 63049823-9dd9-4491-8ac9-480a0562aa72 of volume 0f31b535-f4cc-4c2c-9819-eae7c4226f7b {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] snapshot_file for this snap is: volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[5727dd14-d4ea-4aef-8bd0-738c5fb65895]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:47 devstack sudo[85219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72
Apr 15 23:19:47 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:47 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c 1073741824" returned: 0 in 0.737s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:47 devstack sudo[85224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c
Apr 15 23:19:47 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:48 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72" returned: 0 in 0.737s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[784ccbf3-349d-4e13-a846-db916a843ed0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:48 devstack sudo[85229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b
Apr 15 23:19:48 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:48 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c" returned: 0 in 0.614s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603920d5-5f05-4a71-814f-62f7ad7cfd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22cafe4d-e175-42cf-9d74-8d089127238c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060e1a8e-ab24-4d5d-9529-a9d9ac25a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:48 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Volume volume-22cafe4d-e175-42cf-9d74-8d089127238c (22cafe4d-e175-42cf-9d74-8d089127238c): created successfully
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060e1a8e-ab24-4d5d-9529-a9d9ac25a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Flow 'volume_create_manager' (5d27f8d3-36ca-4b81-b0b4-eb43cff09c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:48 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-198258f3-411a-4909-8ec0-bc736ccdc414 tempest-VolumesTransfersV357Test-439346093 None] Created volume successfully.
Apr 15 23:19:48 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" returned: 0 in 0.617s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:48 devstack sudo[85236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72
Apr 15 23:19:48 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Acquiring lock "cinder-22cafe4d-e175-42cf-9d74-8d089127238c-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Lock "cinder-22cafe4d-e175-42cf-9d74-8d089127238c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Acquiring lock "cinder-quobyte-22cafe4d-e175-42cf-9d74-8d089127238c" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Lock "cinder-quobyte-22cafe4d-e175-42cf-9d74-8d089127238c" acquired by "delete_volume" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b562af0-2137-46da-9c2b-bc9fbd76a60e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:49 devstack sudo[85241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c
Apr 15 23:19:49 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:49 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72" returned: 0 in 0.664s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:49 devstack sudo[85243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72
Apr 15 23:19:49 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:49 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b.63049823-9dd9-4491-8ac9-480a0562aa72" returned: 0 in 0.499s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:49 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c" returned: 0 in 0.692s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-quobyte-63049823-9dd9-4491-8ac9-480a0562aa72" released by "_delete_snapshot" :: held 2.611s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-quobyte-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" released by "delete_snapshot" :: held 2.626s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:49 devstack sudo[85249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c
Apr 15 23:19:49 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:49 devstack cinder-volume[81941]: WARNING cinder.quota [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG cinder.quota [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Created reservations ['748bbd9b-5d42-45e6-8a30-650267836ccd', '5d032e4c-e60e-4e96-ad41-df5aa81250bb', 'b303a594-e11a-46a8-9c7a-7e92beafa36c', 'ff0bcd91-57fb-4ef7-a5aa-28e19183486e'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:49 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Delete snapshot completed successfully.
Apr 15 23:19:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c5a636e2-0eb1-47c3-bbb5-47ca80952c60 req-c7311553-53a9-4542-b1cc-84aea3278ebe tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-63049823-9dd9-4491-8ac9-480a0562aa72-delete_snapshot" released by "delete_snapshot" :: held 2.765s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Flow 'volume_create_manager' (09d8e74e-1b00-4819-8469-4e8dfd4b024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ef0541-4f8f-4a7b-bbca-b360361a8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ef0541-4f8f-4a7b-bbca-b360361a8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1459053295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b8c3e1-d029-4d02-b8f6-fb866d733ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a770ea37c1564c73ac2d2a091749b3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:50Z,use_quota=True,user_id='b406450b0ba947a693854e683814846a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fa42b7-ef1e-4de0-87fb-f848a5380e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fa42b7-ef1e-4de0-87fb-f848a5380e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9087f978-4b11-4d99-9836-9f7a852a1d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9087f978-4b11-4d99-9836-9f7a852a1d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b8c3e1-d029-4d02-b8f6-fb866d733ba3', 'volume_name': 'volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48db3e67-2ed7-46f2-a18d-479c3d61c16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48db3e67-2ed7-46f2-a18d-479c3d61c16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e73021-1f79-4061-bb42-9513ab28d52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:50 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Volume 68b8c3e1-d029-4d02-b8f6-fb866d733ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3', 'volume_size': 1}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1459053295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b8c3e1-d029-4d02-b8f6-fb866d733ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a770ea37c1564c73ac2d2a091749b3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:50Z,use_quota=True,user_id='b406450b0ba947a693854e683814846a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Creating volume 68b8c3e1-d029-4d02-b8f6-fb866d733ba3 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:50 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:50 devstack sudo[85251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3 1073741824
Apr 15 23:19:50 devstack sudo[85251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:50 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-22cafe4d-e175-42cf-9d74-8d089127238c" returned: 0 in 0.461s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Lock "cinder-quobyte-22cafe4d-e175-42cf-9d74-8d089127238c" released by "delete_volume" :: held 1.173s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Created reservations ['9db2224a-792b-4523-a9c9-750792c122e2', '1fcf01d7-3e2c-4bd8-8d64-5050e1696d0a', 'bfaad568-461c-466d-95ae-3be9f661e1ed', 'cb4a3940-988a-4b9b-a9d4-b9d63edfae3e'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:50 devstack sudo[85260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:50 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "cinder-0f31b535-f4cc-4c2c-9819-eae7c4226f7b-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-0f31b535-f4cc-4c2c-9819-eae7c4226f7b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "cinder-quobyte-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-quobyte-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce841f4-c446-4eb6-a4cf-0509931eeae6]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:50 devstack sudo[85273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b
Apr 15 23:19:50 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:50 devstack sudo[85251]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3 1073741824" returned: 0 in 0.699s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:50 devstack sudo[85284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3
Apr 15 23:19:50 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:50 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.620s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Deleted volume successfully.
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e598ffe2-1ff1-4b20-ab20-9b07590f7ad0 tempest-VolumesTransfersV357Test-136578046 None] Lock "cinder-22cafe4d-e175-42cf-9d74-8d089127238c-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:51 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" returned: 0 in 0.618s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:51 devstack sudo[85291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b
Apr 15 23:19:51 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:51 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3" returned: 0 in 0.450s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e73021-1f79-4061-bb42-9513ab28d52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1070b1f-bfb4-44b4-a98e-fa37a40c1312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:51 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Volume volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3 (68b8c3e1-d029-4d02-b8f6-fb866d733ba3): created successfully
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1070b1f-bfb4-44b4-a98e-fa37a40c1312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Flow 'volume_create_manager' (09d8e74e-1b00-4819-8469-4e8dfd4b024b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b3e196c1-cfbe-49e8-8768-23dcbcfdc6e7 tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Created volume successfully.
Apr 15 23:19:51 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" returned: 0 in 0.520s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-quobyte-0f31b535-f4cc-4c2c-9819-eae7c4226f7b" released by "delete_volume" :: held 1.191s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.quota [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Created reservations ['c24e3d8b-25fd-4741-9bac-ee4180dfc84b', '3fdee787-09df-4f35-b802-38f11d621f72', 'c02f8b02-1787-48f4-a9cd-14653f83fd3c', '0388fe27-3ac4-4b37-89d9-05ebd05482da'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:51 devstack sudo[85294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:51 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:52 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.670s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:52 devstack cinder-volume[81941]: DEBUG cinder.manager [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:52 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Deleted volume successfully.
Apr 15 23:19:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-c80d1da2-58f5-4a61-afd0-2b8b0fe8bcbc req-a3e9ad81-4cf6-427f-a158-4c8571b8677d tempest-VolumesSnapshotsTestJSON-2070856754 None] Lock "cinder-0f31b535-f4cc-4c2c-9819-eae7c4226f7b-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Acquiring lock "cinder-68b8c3e1-d029-4d02-b8f6-fb866d733ba3-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "cinder-68b8c3e1-d029-4d02-b8f6-fb866d733ba3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Acquiring lock "cinder-quobyte-68b8c3e1-d029-4d02-b8f6-fb866d733ba3" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:19:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "cinder-quobyte-68b8c3e1-d029-4d02-b8f6-fb866d733ba3" acquired by "delete_volume" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:19:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[12793b1e-10e9-41d3-a56e-b83dd32eaf00]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:19:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:53 devstack sudo[85297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3
Apr 15 23:19:53 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:54 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3" returned: 0 in 0.830s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:54 devstack sudo[85302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3
Apr 15 23:19:54 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:54 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68b8c3e1-d029-4d02-b8f6-fb866d733ba3" returned: 0 in 0.598s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "cinder-quobyte-68b8c3e1-d029-4d02-b8f6-fb866d733ba3" released by "delete_volume" :: held 1.485s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Created reservations ['3edd6ebe-26df-4817-b7de-a6b19609aefb', '07c38179-f696-48fe-a059-cb228af8019f', '181da825-f81b-422c-a8f1-10e8b79c4411', '47a54f04-0e5d-49f1-86d8-66509992f2f2'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:55 devstack sudo[85306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:55 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:55 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.770s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Deleted volume successfully.
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-be266e2a-d443-4147-a06d-cabbae12bfcd tempest-VolumeQuotasNegativeTestJSON-1756381152 None] Lock "cinder-68b8c3e1-d029-4d02-b8f6-fb866d733ba3-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Flow 'volume_create_manager' (7586b982-e190-42ea-a736-37399169685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3316498-93bf-4cdb-bfc6-30fda2a6c5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3316498-93bf-4cdb-bfc6-30fda2a6c5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-804004815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e7f59-2523-4500-bf19-85225dacae44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e20ad5c2b8e4ad9a9e096dd0c3d238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:56Z,use_quota=True,user_id='c809ea3dc20d4435956b064c67ca7e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092f7967-d605-47ac-b6a4-1cd72e184cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092f7967-d605-47ac-b6a4-1cd72e184cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc72c620-d017-4360-979a-6e1790253a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc72c620-d017-4360-979a-6e1790253a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8e7f59-2523-4500-bf19-85225dacae44', 'volume_name': 'volume-bd8e7f59-2523-4500-bf19-85225dacae44', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4d0df4-3a9e-47d3-a65d-3c8a3ab07f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4d0df4-3a9e-47d3-a65d-3c8a3ab07f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a17633-9e3a-4c2f-8ee1-c9527604f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:56 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Volume bd8e7f59-2523-4500-bf19-85225dacae44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8e7f59-2523-4500-bf19-85225dacae44', 'volume_size': 1}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-804004815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e7f59-2523-4500-bf19-85225dacae44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e20ad5c2b8e4ad9a9e096dd0c3d238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:56Z,use_quota=True,user_id='c809ea3dc20d4435956b064c67ca7e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Creating volume bd8e7f59-2523-4500-bf19-85225dacae44 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:56 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:56 devstack sudo[85310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44 1073741824
Apr 15 23:19:56 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:56 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44 1073741824" returned: 0 in 0.749s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:56 devstack sudo[85320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44
Apr 15 23:19:56 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:57 devstack sudo[85324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:19:57 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:57 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44" returned: 0 in 0.677s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a17633-9e3a-4c2f-8ee1-c9527604f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8e7f59-2523-4500-bf19-85225dacae44', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bcfec8-eb63-4995-a1c2-ea0df3eab8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:57 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Volume volume-bd8e7f59-2523-4500-bf19-85225dacae44 (bd8e7f59-2523-4500-bf19-85225dacae44): created successfully
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bcfec8-eb63-4995-a1c2-ea0df3eab8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Flow 'volume_create_manager' (7586b982-e190-42ea-a736-37399169685f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2724e7fc-ee0d-4d53-a4da-0256407b1260 tempest-VolumesListTestJSON-275094922 None] Created volume successfully.
Apr 15 23:19:57 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.692s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Flow 'volume_create_manager' (f6878dcb-7fd1-4d84-8a1f-cc7698c96ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadb7f75-ea0f-4f71-b8c7-d96665f3164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadb7f75-ea0f-4f71-b8c7-d96665f3164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1775972108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb56d993-173d-45da-b669-4d81233d404a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e20ad5c2b8e4ad9a9e096dd0c3d238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:58Z,use_quota=True,user_id='c809ea3dc20d4435956b064c67ca7e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8ac5f9-1701-4b4e-a9f1-b083fdf62417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8ac5f9-1701-4b4e-a9f1-b083fdf62417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d80d94-e2fe-4990-8edf-3e1095573ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d80d94-e2fe-4990-8edf-3e1095573ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb56d993-173d-45da-b669-4d81233d404a', 'volume_name': 'volume-cb56d993-173d-45da-b669-4d81233d404a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a626169-e0a9-49a3-abe9-8116637a2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a626169-e0a9-49a3-abe9-8116637a2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b9aa60-8b67-46aa-ae73-53b643c2fbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:19:58 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Volume cb56d993-173d-45da-b669-4d81233d404a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb56d993-173d-45da-b669-4d81233d404a', 'volume_size': 1}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1775972108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb56d993-173d-45da-b669-4d81233d404a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e20ad5c2b8e4ad9a9e096dd0c3d238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:58Z,use_quota=True,user_id='c809ea3dc20d4435956b064c67ca7e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Creating volume cb56d993-173d-45da-b669-4d81233d404a {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:19:58 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:19:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:58 devstack sudo[85328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a 1073741824
Apr 15 23:19:58 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:59 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a 1073741824" returned: 0 in 0.768s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:19:59 devstack sudo[85333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a
Apr 15 23:19:59 devstack sudo[85333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:19:59 devstack sudo[85333]: pam_unix(sudo:session): session closed for user root
Apr 15 23:19:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a" returned: 0 in 0.630s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:19:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:19:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:19:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b9aa60-8b67-46aa-ae73-53b643c2fbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb56d993-173d-45da-b669-4d81233d404a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:19:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7d2b04-726f-4243-91c8-a200767d403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:00 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Volume volume-cb56d993-173d-45da-b669-4d81233d404a (cb56d993-173d-45da-b669-4d81233d404a): created successfully
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7d2b04-726f-4243-91c8-a200767d403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Flow 'volume_create_manager' (f6878dcb-7fd1-4d84-8a1f-cc7698c96ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:00 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-68d34058-7cc8-4402-81ae-6243c09d07c2 tempest-VolumesListTestJSON-275094922 None] Created volume successfully.
Apr 15 23:20:00 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-07cb5f1d-29df-4862-81fb-13a188786d12 tempest-GroupsV320Test-1034731690 None] Group tempest-GroupsV320Test-Group-1122808085: creating
Apr 15 23:20:00 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-07cb5f1d-29df-4862-81fb-13a188786d12 tempest-GroupsV320Test-1034731690 None] Group tempest-GroupsV320Test-Group-1122808085: created successfully
Apr 15 23:20:00 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-07cb5f1d-29df-4862-81fb-13a188786d12 tempest-GroupsV320Test-1034731690 None] Create group completed successfully.
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Flow 'volume_create_manager' (7ea0471d-b73e-4049-8b66-d7adb6a86ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130869fb-753b-4973-9816-b651d6ffe6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130869fb-753b-4973-9816-b651d6ffe6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1879926315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6147b8-91bf-40bc-914b-768247f3a3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d599681cd6544342b98a8720738df0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:01Z,use_quota=True,user_id='c71b67dcd6e140b0a8e7f20595355877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611ee53a-0ca2-4135-b914-583d82c6955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611ee53a-0ca2-4135-b914-583d82c6955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8855c1-31b1-4620-bf4e-cf32ab87c64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8855c1-31b1-4620-bf4e-cf32ab87c64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6147b8-91bf-40bc-914b-768247f3a3cd', 'volume_name': 'volume-1d6147b8-91bf-40bc-914b-768247f3a3cd', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b964d3f9-fd49-4515-b879-7d9b6ef1fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b964d3f9-fd49-4515-b879-7d9b6ef1fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33353fbb-41a3-401f-a059-0bcebf65f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:00 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Volume 1d6147b8-91bf-40bc-914b-768247f3a3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6147b8-91bf-40bc-914b-768247f3a3cd', 'volume_size': 1}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1879926315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6147b8-91bf-40bc-914b-768247f3a3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d599681cd6544342b98a8720738df0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:01Z,use_quota=True,user_id='c71b67dcd6e140b0a8e7f20595355877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Creating volume 1d6147b8-91bf-40bc-914b-768247f3a3cd {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:00 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:00 devstack sudo[85336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd 1073741824
Apr 15 23:20:00 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:00 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Flow 'volume_create_manager' (ba24ba4b-e341-4227-a79d-56d017ceebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ed48e4-a074-4f31-8ee6-07e9e7edb1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ed48e4-a074-4f31-8ee6-07e9e7edb1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1743557667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e20ad5c2b8e4ad9a9e096dd0c3d238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:01Z,use_quota=True,user_id='c809ea3dc20d4435956b064c67ca7e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84edb65f-83b4-49ec-8b68-48121b694110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84edb65f-83b4-49ec-8b68-48121b694110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef85554a-d48a-4614-a942-33c20b3945ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef85554a-d48a-4614-a942-33c20b3945ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8', 'volume_name': 'volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911752c0-3181-4c65-888c-748bf6903383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911752c0-3181-4c65-888c-748bf6903383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30d1698-0c9f-4c87-baab-a840b4d167ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:01 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Volume 3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8', 'volume_size': 1}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:01 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd 1073741824" returned: 0 in 0.632s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:01 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd
Apr 15 23:20:01 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:02 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd" returned: 0 in 0.632s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.068s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1743557667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e20ad5c2b8e4ad9a9e096dd0c3d238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:01Z,use_quota=True,user_id='c809ea3dc20d4435956b064c67ca7e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Creating volume 3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:02 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33353fbb-41a3-401f-a059-0bcebf65f15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6147b8-91bf-40bc-914b-768247f3a3cd', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5304b1e-bf01-4138-a7e7-731a1e10c5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:02 devstack sudo[85345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8 1073741824
Apr 15 23:20:02 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:02 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Volume volume-1d6147b8-91bf-40bc-914b-768247f3a3cd (1d6147b8-91bf-40bc-914b-768247f3a3cd): created successfully
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5304b1e-bf01-4138-a7e7-731a1e10c5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Flow 'volume_create_manager' (7ea0471d-b73e-4049-8b66-d7adb6a86ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:02 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8539a0eb-52cb-48cc-a628-312671201d93 tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Created volume successfully.
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Created reservations ['a0c46183-0ea5-478c-be63-e0d2715d4a1c'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:02 devstack sudo[85347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:02 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:03 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8 1073741824" returned: 0 in 0.972s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:03 devstack sudo[85355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8
Apr 15 23:20:03 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:03 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.929s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-92e341a1-63e1-451d-b8de-506ed4047763 tempest-GroupsV320Test-1034731690 None] Delete group completed successfully.
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Flow 'volume_create_manager' (230e0f9a-655f-4973-9e69-250bd0af677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44405a79-2f20-4ae5-af2a-7796c6d67dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44405a79-2f20-4ae5-af2a-7796c6d67dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:03Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b5074d-c7aa-4c19-8606-c9c0d9554ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d736efcab6fa4adfa4a5e1de8aeb52ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:03Z,use_quota=True,user_id='fef97315bc3c4af79a42e5812cfcd0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d79e38e-44ac-420b-b783-2b3c38d7aa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d79e38e-44ac-420b-b783-2b3c38d7aa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd69405-09c2-4d83-8ff6-daa3aa99d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.image.glance [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Creating Keystone auth plugin from conf {{(pid=81941) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd69405-09c2-4d83-8ff6-daa3aa99d874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59b5074d-c7aa-4c19-8606-c9c0d9554ac1', 'volume_name': 'volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f11560eefb0>}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8fe2a9-5713-4adf-99da-3d4513df899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8fe2a9-5713-4adf-99da-3d4513df899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59621ea9-27db-4646-a9c4-f80be3baa971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:03 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Volume 59b5074d-c7aa-4c19-8606-c9c0d9554ac1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f11560eefb0>}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Trying to clone 59b5074d-c7aa-4c19-8606-c9c0d9554ac1 from image 0e2861bb-d33e-45a3-86bc-d3d94070676e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]). {{(pid=81941) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 23:20:03 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8" returned: 0 in 0.726s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.656s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30d1698-0c9f-4c87-baab-a840b4d167ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b0f840-071c-40d2-9bb6-e1be6aa6d9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Creating offline snapshot 8bfa79ef-2a9f-4480-b423-e32d95c8f798 of volume 1d6147b8-91bf-40bc-914b-768247f3a3cd {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:20:03 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Volume volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8 (3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8): created successfully
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b0f840-071c-40d2-9bb6-e1be6aa6d9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Flow 'volume_create_manager' (ba24ba4b-e341-4227-a79d-56d017ceebea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ee10a-b696-43bf-8c0e-4052e8bb5f1f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6ccb5fca-abed-421f-b396-a7a237740b3a tempest-VolumesListTestJSON-275094922 None] Created volume successfully.
Apr 15 23:20:04 devstack sudo[85378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd
Apr 15 23:20:04 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 23:20:04 devstack cinder-volume[81941]: INFO cinder.image.image_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 23:20:04 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:04 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4130297a-32a4-4427-817c-7affa6447f72]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:04 devstack sudo[85381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD
Apr 15 23:20:04 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:04 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:04 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Temporary image 0e2861bb-d33e-45a3-86bc-d3d94070676e is fetched for user fef97315bc3c4af79a42e5812cfcd0c6. {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 23:20:05 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[40145ff9-2718-41d1-b994-6ea9f61eb5ec]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:05 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd" returned: 0 in 1.177s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:05 devstack sudo[85394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 1G
Apr 15 23:20:05 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:05 devstack sudo[85393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD
Apr 15 23:20:05 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:05 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 1G" returned: 0 in 0.725s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6147b8-91bf-40bc-914b-768247f3a3cd -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:05 devstack sudo[85437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6147b8-91bf-40bc-914b-768247f3a3cd -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798
Apr 15 23:20:05 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:06 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD" returned: 0 in 0.963s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:06 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6147b8-91bf-40bc-914b-768247f3a3cd -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798" returned: 0 in 0.641s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:06 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 is being set with open permissions: ugo+rw
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:06 devstack sudo[85445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798
Apr 15 23:20:06 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Acquiring lock "cinder-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Lock "cinder-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Acquiring lock "cinder-quobyte-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Lock "cinder-quobyte-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8" acquired by "delete_volume" :: waited 0.020s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e9cf0-82fd-4055-be30-f15e12105cb8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:07 devstack sudo[85447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8
Apr 15 23:20:07 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:07 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798" returned: 0 in 0.620s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:07 devstack sudo[85450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.info
Apr 15 23:20:07 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:07 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8" returned: 0 in 0.591s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:07 devstack sudo[85455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8
Apr 15 23:20:07 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:07 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.info" returned: 0 in 0.503s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:07 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.info is being set with open permissions: ugo+rw
Apr 15 23:20:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:07 devstack sudo[85458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.info
Apr 15 23:20:07 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:08 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8" returned: 0 in 0.607s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Lock "cinder-quobyte-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8" released by "delete_volume" :: held 1.220s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Created reservations ['03dadafd-4fd2-42cb-bbdd-b576d9d53d6e', '71a14cdb-2540-4427-be0f-e3a8383a7fec', 'c1a33a1c-4c7b-4933-8ab4-0dc6ddb93026', 'f8a28c3e-361e-4215-9ee0-44d098932c6c'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:08 devstack sudo[85479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:08 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:08 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.info" returned: 0 in 0.625s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.413s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.261s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:03Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b5074d-c7aa-4c19-8606-c9c0d9554ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d736efcab6fa4adfa4a5e1de8aeb52ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:03Z,use_quota=True,user_id='fef97315bc3c4af79a42e5812cfcd0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Creating volume 59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:08 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:08 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e7f48103-f6c8-4136-b4eb-6abe392e312c tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Create snapshot completed successfully
Apr 15 23:20:08 devstack sudo[85481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 1073741824
Apr 15 23:20:08 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:08 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.684s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:08 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Deleted volume successfully.
Apr 15 23:20:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8b1f7b7a-e2f8-49f1-812d-2e3352533e7c tempest-VolumesListTestJSON-275094922 None] Lock "cinder-3f25b322-7ef1-4f7e-9d31-e25b3ca4cbc8-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:09 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 1073741824" returned: 0 in 0.720s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "cinder-8bfa79ef-2a9f-4480-b423-e32d95c8f798-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-8bfa79ef-2a9f-4480-b423-e32d95c8f798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "cinder-quobyte-1d6147b8-91bf-40bc-914b-768247f3a3cd" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-quobyte-1d6147b8-91bf-40bc-914b-768247f3a3cd" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "cinder-quobyte-8bfa79ef-2a9f-4480-b423-e32d95c8f798" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-quobyte-8bfa79ef-2a9f-4480-b423-e32d95c8f798" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Deleting offline snapshot 8bfa79ef-2a9f-4480-b423-e32d95c8f798 of volume 1d6147b8-91bf-40bc-914b-768247f3a3cd {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:20:09 devstack sudo[85487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:09 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] snapshot_file for this snap is: volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c426cea8-ed12-4177-af92-ddb1f553b8be]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:09 devstack sudo[85489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798
Apr 15 23:20:09 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Acquiring lock "cinder-cb56d993-173d-45da-b669-4d81233d404a-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Lock "cinder-cb56d993-173d-45da-b669-4d81233d404a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Acquiring lock "cinder-quobyte-cb56d993-173d-45da-b669-4d81233d404a" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Lock "cinder-quobyte-cb56d993-173d-45da-b669-4d81233d404a" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dee63c-ea1c-4daf-95a9-b59df5fb8452]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:09 devstack sudo[85491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a
Apr 15 23:20:09 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:09 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 0 in 0.785s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Attempting download of 0e2861bb-d33e-45a3-86bc-d3d94070676e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}])) to volume 59b5074d-c7aa-4c19-8606-c9c0d9554ac1. {{(pid=81941) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f3270-047a-41f7-8206-cd6333871ad0]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_16yn5cpg {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:09 devstack sudo[85497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_16yn5cpg
Apr 15 23:20:09 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:10 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798" returned: 0 in 0.927s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d6147b8-91bf-40bc-914b-768247f3a3cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:10 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4ec324-3cc5-431e-be77-fb02ea344951]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:10 devstack sudo[85499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd
Apr 15 23:20:10 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:10 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a" returned: 0 in 0.951s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:10 devstack sudo[85504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a
Apr 15 23:20:10 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:10 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_16yn5cpg" returned: 0 in 0.592s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_16yn5cpg {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:10 devstack sudo[85508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_16yn5cpg
Apr 15 23:20:10 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:11 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_16yn5cpg" returned: 1 in 0.558s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_16yn5cpg' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e1de2c-45d8-486f-9374-a004bd71f1c5]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:11 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:11 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cb56d993-173d-45da-b669-4d81233d404a" returned: 0 in 0.885s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd" returned: 0 in 1.115s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Lock "cinder-quobyte-cb56d993-173d-45da-b669-4d81233d404a" released by "delete_volume" :: held 1.865s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:11 devstack sudo[85516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD
Apr 15 23:20:11 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:11 devstack sudo[85517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798
Apr 15 23:20:11 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Created reservations ['1d71e2b1-3245-4309-b7eb-3ef809ff73d2', 'c369ca32-481e-475e-a685-e7a6f08b1f3c', '74132fe2-7a0b-464f-8b3c-02fb99710428', '6b31cd3d-3caa-4127-a1a8-ae5a3dfa2124'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:11 devstack sudo[85520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:11 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Acquiring lock "cinder-bd8e7f59-2523-4500-bf19-85225dacae44-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Lock "cinder-bd8e7f59-2523-4500-bf19-85225dacae44-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Acquiring lock "cinder-quobyte-bd8e7f59-2523-4500-bf19-85225dacae44" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Lock "cinder-quobyte-bd8e7f59-2523-4500-bf19-85225dacae44" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3696df74-ed0b-4eea-8d41-6de59b74f9bb]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:11 devstack sudo[85525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44
Apr 15 23:20:11 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:11 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] 0e2861bb-d33e-45a3-86bc-d3d94070676e was qcow2, converting to raw {{(pid=81941) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:11 devstack sudo[85530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:11 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:11 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798" returned: 0 in 0.844s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:12 devstack sudo[85533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798
Apr 15 23:20:12 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:12 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.953s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:12 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Deleted volume successfully.
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a8683845-6034-4370-937c-bab69129f12b tempest-VolumesListTestJSON-275094922 None] Lock "cinder-cb56d993-173d-45da-b669-4d81233d404a-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:12 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44" returned: 0 in 0.873s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:12 devstack sudo[85541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44
Apr 15 23:20:12 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:12 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd.8bfa79ef-2a9f-4480-b423-e32d95c8f798" returned: 0 in 0.888s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-quobyte-8bfa79ef-2a9f-4480-b423-e32d95c8f798" released by "_delete_snapshot" :: held 3.859s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-quobyte-1d6147b8-91bf-40bc-914b-768247f3a3cd" released by "delete_snapshot" :: held 3.870s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:12 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Created reservations ['2d8ab941-71a7-4521-ad7e-ac38860117cb', '3059eaea-0049-414c-b3d9-b370375f1dfd', '02958642-ef17-4b8f-905c-c555db88f02e', '3b64fa59-03e1-4d8a-ad4e-ff2fea5bc6a5'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:13 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Delete snapshot completed successfully.
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5da465d7-bb21-4670-9794-41e07b79fa1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-8bfa79ef-2a9f-4480-b423-e32d95c8f798-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "cinder-1d6147b8-91bf-40bc-914b-768247f3a3cd-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-1d6147b8-91bf-40bc-914b-768247f3a3cd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:13 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 0 in 1.470s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_ntp0zfdzdevstack@QuobyteHD, size 112.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:20:13 devstack cinder-volume[81941]: INFO cinder.image.image_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Converted 112.00 MB image at 76.14 MB/s
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:13 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bd8e7f59-2523-4500-bf19-85225dacae44" returned: 0 in 0.830s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:13 devstack sudo[85547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 1G
Apr 15 23:20:13 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "cinder-quobyte-1d6147b8-91bf-40bc-914b-768247f3a3cd" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Lock "cinder-quobyte-bd8e7f59-2523-4500-bf19-85225dacae44" released by "delete_volume" :: held 1.758s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-quobyte-1d6147b8-91bf-40bc-914b-768247f3a3cd" acquired by "delete_volume" :: waited 0.037s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9712d27-6f58-434e-adeb-fec4632e61ad]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Created reservations ['f80e5930-cdda-4efc-99f5-0ee18f64feb5', 'ac3e1e66-3da7-44c1-92ff-9a6e416e16b4', '3d25c780-fcda-4f91-895e-5b451e2ed927', '06c4d28e-42bc-4700-a54d-612b6127e370'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:13 devstack sudo[85551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd
Apr 15 23:20:13 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:13 devstack sudo[85552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:13 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:14 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 1G" returned: 0 in 0.865s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:14 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.642s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:14 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Deleted volume successfully.
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c05d29b0-8eb7-4d29-b9ed-5ccf5437deff tempest-VolumesListTestJSON-275094922 None] Lock "cinder-bd8e7f59-2523-4500-bf19-85225dacae44-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb3783-b15c-4f54-be5e-3ea8def8c827]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:14 devstack sudo[85559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:14 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Flow 'volume_create_manager' (a11f9f00-b8f2-4ea7-9a5d-31807aea247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:14 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f654b22e-257f-4944-b876-d7b9ec698c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd" returned: 0 in 0.979s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f654b22e-257f-4944-b876-d7b9ec698c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-319378845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb9d523-9495-4255-9c45-1944ff300a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187aeef84f7d489fab0caca96803897e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='f469946ac0ba40f4a7f986a10ab7aab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63cd164-b742-4ae0-8c2d-8378e26057d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63cd164-b742-4ae0-8c2d-8378e26057d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8693fbc5-b368-4a64-a7da-e0134986a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8693fbc5-b368-4a64-a7da-e0134986a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb9d523-9495-4255-9c45-1944ff300a5c', 'volume_name': 'volume-1cb9d523-9495-4255-9c45-1944ff300a5c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bba7c1a-c911-484b-a113-010a12f83954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bba7c1a-c911-484b-a113-010a12f83954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb82644a-cd12-488e-8a2e-75c2d8426df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:14 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Volume 1cb9d523-9495-4255-9c45-1944ff300a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb9d523-9495-4255-9c45-1944ff300a5c', 'volume_size': 1}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-319378845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb9d523-9495-4255-9c45-1944ff300a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187aeef84f7d489fab0caca96803897e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='f469946ac0ba40f4a7f986a10ab7aab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Creating volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:14 devstack sudo[85564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:14 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:14 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:14 devstack sudo[85565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c 1073741824
Apr 15 23:20:14 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:15 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 0 in 0.912s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:15 devstack sudo[85573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:15 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:15 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c 1073741824" returned: 0 in 0.734s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:15 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c
Apr 15 23:20:15 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:15 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1d6147b8-91bf-40bc-914b-768247f3a3cd" returned: 0 in 0.935s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-quobyte-1d6147b8-91bf-40bc-914b-768247f3a3cd" released by "delete_volume" :: held 1.981s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Created reservations ['48219b7e-1d84-423c-a1a1-7b17847318ee', '1aa876a0-512d-4dff-8e7a-a1be7c471a4e', '3faa3be2-3555-4d12-91ba-98f381711e23', 'f3413c3c-7832-4f0e-8c49-fa6f568de1c3'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:15 devstack sudo[85579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:15 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:15 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 1 in 0.735s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Downloaded image 0e2861bb-d33e-45a3-86bc-d3d94070676e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}])) to volume 59b5074d-c7aa-4c19-8606-c9c0d9554ac1 successfully. {{(pid=81941) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Temporary image 0e2861bb-d33e-45a3-86bc-d3d94070676e for user fef97315bc3c4af79a42e5812cfcd0c6 is deleted. {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 23:20:15 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Marking volume 59b5074d-c7aa-4c19-8606-c9c0d9554ac1 as bootable. {{(pid=81941) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Copying metadata from image 0e2861bb-d33e-45a3-86bc-d3d94070676e to 59b5074d-c7aa-4c19-8606-c9c0d9554ac1. {{(pid=81941) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Creating volume glance metadata for volume 59b5074d-c7aa-4c19-8606-c9c0d9554ac1 backed by image 0e2861bb-d33e-45a3-86bc-d3d94070676e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81941) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 23:20:16 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c" returned: 0 in 0.720s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb82644a-cd12-488e-8a2e-75c2d8426df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb9d523-9495-4255-9c45-1944ff300a5c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86835541-4ca3-4dec-a842-4c5e6224f491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Volume volume-1cb9d523-9495-4255-9c45-1944ff300a5c (1cb9d523-9495-4255-9c45-1944ff300a5c): created successfully
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86835541-4ca3-4dec-a842-4c5e6224f491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Flow 'volume_create_manager' (a11f9f00-b8f2-4ea7-9a5d-31807aea247c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:16 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e11693bf-7bd7-4dab-b925-6934ee9d17e1 tempest-SnapshotsActionsTest-1837188190 None] Created volume successfully.
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59621ea9-27db-4646-a9c4-f80be3baa971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f11560eefb0>}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9692831f-6e03-40e5-ab4b-de0cd927133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Volume volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 (59b5074d-c7aa-4c19-8606-c9c0d9554ac1): created successfully
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9692831f-6e03-40e5-ab4b-de0cd927133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Flow 'volume_create_manager' (230e0f9a-655f-4973-9e69-250bd0af677f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:16 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.607s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:16 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-8b547975-553c-4a82-a96c-76a8a1e54c14 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Created volume successfully.
Apr 15 23:20:16 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Deleted volume successfully.
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eea5b931-bd17-49ce-828a-6b805884b53e tempest-VolumeSnapshotQuotasNegativeTestJSON-1859906839 None] Lock "cinder-1d6147b8-91bf-40bc-914b-768247f3a3cd-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (729f1a46-0e8a-435d-9f73-19590cbb8c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c35a7d-963d-4441-a731-b88bb5f67253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c35a7d-963d-4441-a731-b88bb5f67253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244657070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c677f6ab-5ce1-4db9-821f-386a3cc0f375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:16Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d846ee02-750f-4dca-bffa-d6db7f6e63af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d846ee02-750f-4dca-bffa-d6db7f6e63af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72003be4-5b35-488d-b2b9-b7075efb1add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72003be4-5b35-488d-b2b9-b7075efb1add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c677f6ab-5ce1-4db9-821f-386a3cc0f375', 'volume_name': 'volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b56a6a-a445-46d5-be7c-9af753b8748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b56a6a-a445-46d5-be7c-9af753b8748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f856943-f318-45fa-860d-8fb921cc11b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Volume c677f6ab-5ce1-4db9-821f-386a3cc0f375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375', 'volume_size': 1}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244657070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c677f6ab-5ce1-4db9-821f-386a3cc0f375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:16Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Creating volume c677f6ab-5ce1-4db9-821f-386a3cc0f375 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:16 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:16 devstack sudo[85586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375 1073741824
Apr 15 23:20:16 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (f736feeb-43e5-4ca0-85c3-6623bfd16b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7aa13b-5c4c-471e-b34a-e42fee01a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7aa13b-5c4c-471e-b34a-e42fee01a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147445073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc0239d-f241-41ae-974a-8995687e13c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:17Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a015ce4-7cf2-487d-897b-881ffaf33706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a015ce4-7cf2-487d-897b-881ffaf33706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0028ee03-1c0e-46f3-8ed0-266f9271e3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0028ee03-1c0e-46f3-8ed0-266f9271e3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc0239d-f241-41ae-974a-8995687e13c5', 'volume_name': 'volume-2dc0239d-f241-41ae-974a-8995687e13c5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c63c8b7-6cf7-4887-a368-7dbbbfc1d939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c63c8b7-6cf7-4887-a368-7dbbbfc1d939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9394752-aa65-4a91-98d7-27b22c77da71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:16 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Volume 2dc0239d-f241-41ae-974a-8995687e13c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc0239d-f241-41ae-974a-8995687e13c5', 'volume_size': 1}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:16 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (7e9a5efc-d898-4bce-8105-3339bb8ded29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9184c6f-6126-49d4-811f-7eb8785aff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9184c6f-6126-49d4-811f-7eb8785aff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768358239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bb1dcb-ce37-403d-97cc-3692c6cb2ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:17Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268ce5a0-2ffb-4c9c-a065-1a4c422007e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268ce5a0-2ffb-4c9c-a065-1a4c422007e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e444cb29-da0a-41f2-a187-ae00c3f97116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e444cb29-da0a-41f2-a187-ae00c3f97116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bb1dcb-ce37-403d-97cc-3692c6cb2ded', 'volume_name': 'volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0acce34-be1c-4ff2-a7ed-0fbd5faa653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0acce34-be1c-4ff2-a7ed-0fbd5faa653f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533037be-2164-4c59-95fe-bcfd31ee1059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Volume 97bb1dcb-ce37-403d-97cc-3692c6cb2ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded', 'volume_size': 1}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (d20185f3-51a7-4f48-b6e9-480db09dea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9842e2dc-8981-40c5-a79c-4c5b54c41afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9842e2dc-8981-40c5-a79c-4c5b54c41afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1401151279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98ef806-1d70-495d-9b29-342f67796277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:17Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3b8763-0e4e-4976-9835-9103405fbbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3b8763-0e4e-4976-9835-9103405fbbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6823e701-63f2-4603-9391-6bbb055daaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6823e701-63f2-4603-9391-6bbb055daaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98ef806-1d70-495d-9b29-342f67796277', 'volume_name': 'volume-b98ef806-1d70-495d-9b29-342f67796277', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3006cb98-df7c-4f73-b728-99a70f4b738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3006cb98-df7c-4f73-b728-99a70f4b738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31985dca-4a14-4cc7-94e3-fd27e91a04b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Volume b98ef806-1d70-495d-9b29-342f67796277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98ef806-1d70-495d-9b29-342f67796277', 'volume_size': 1}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (3934e503-bee0-4dcc-8be0-6d19aa82a8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbc9f52-cc76-4c1e-a041-ee72d2c6a4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbc9f52-cc76-4c1e-a041-ee72d2c6a4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128734296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e974e7-8703-4309-a8b8-b9544bab2e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:17Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4fcdca-474e-442e-be1e-de11404ccc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4fcdca-474e-442e-be1e-de11404ccc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d43ef15-f2c9-4a10-9584-18281055602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d43ef15-f2c9-4a10-9584-18281055602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e974e7-8703-4309-a8b8-b9544bab2e31', 'volume_name': 'volume-38e974e7-8703-4309-a8b8-b9544bab2e31', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced36450-ee5c-4705-861f-8c7b5f46da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced36450-ee5c-4705-861f-8c7b5f46da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a76ad7f-9389-4bae-b87e-8b953e78a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Volume 38e974e7-8703-4309-a8b8-b9544bab2e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e974e7-8703-4309-a8b8-b9544bab2e31', 'volume_size': 1}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375 1073741824" returned: 0 in 0.749s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:17 devstack sudo[85591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375
Apr 15 23:20:17 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:17 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375" returned: 0 in 0.402s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.905s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f856943-f318-45fa-860d-8fb921cc11b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8490825-9b4c-489b-975d-572980e10b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Creating offline snapshot 635be015-a98c-4af9-91a5-b3000f66e9d6 of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[31331774-60b4-49f2-a631-d9c43cb80259]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Volume volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375 (c677f6ab-5ce1-4db9-821f-386a3cc0f375): created successfully
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8490825-9b4c-489b-975d-572980e10b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (729f1a46-0e8a-435d-9f73-19590cbb8c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6b84c936-403a-4226-bb48-0badf0defcec tempest-CreateVolumesFromImageTest-1185681056 None] Created volume successfully.
Apr 15 23:20:17 devstack sudo[85594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c
Apr 15 23:20:17 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:18 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c" returned: 0 in 0.545s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:18 devstack sudo[85599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 1G
Apr 15 23:20:18 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:18 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 1G" returned: 0 in 0.565s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:19 devstack sudo[85611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:19 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:19 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.436s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:19 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 is being set with open permissions: ugo+rw
Apr 15 23:20:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:19 devstack sudo[85617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:19 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:19 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.541s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:20 devstack sudo[85620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.info
Apr 15 23:20:20 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:20 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.info" returned: 0 in 0.505s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:20 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.info is being set with open permissions: ugo+rw
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:20 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.info
Apr 15 23:20:20 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Flow 'volume_create_manager' (78858aaf-91e5-4013-b15d-334fe14627c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb46f289-cbba-45eb-adac-3233a3fd039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb46f289-cbba-45eb-adac-3233a3fd039d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1271587685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e61475-fe4a-4077-9000-f6ef47911efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9a5d0744954644bdfbc0675b177943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:21Z,use_quota=True,user_id='f44e7ff35b7f482aa5c928acfab44adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be24bd3b-afa6-4d94-b579-a3978b89fe2c),volume_type_id=be24bd3b-afa6-4d94-b579-a3978b89fe2c)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4e7d39-6fcc-4471-9823-eddd0cea0579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4e7d39-6fcc-4471-9823-eddd0cea0579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35a8f44-1400-48a0-8c2a-656ca68f5708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35a8f44-1400-48a0-8c2a-656ca68f5708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e61475-fe4a-4077-9000-f6ef47911efe', 'volume_name': 'volume-21e61475-fe4a-4077-9000-f6ef47911efe', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cff1936-28fa-40fa-b020-befdd70028ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cff1936-28fa-40fa-b020-befdd70028ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f329566-b521-48fb-a76c-b1e5c033ff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:20 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Volume 21e61475-fe4a-4077-9000-f6ef47911efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e61475-fe4a-4077-9000-f6ef47911efe', 'volume_size': 1}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:20 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.info" returned: 0 in 0.465s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.126s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.993s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147445073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc0239d-f241-41ae-974a-8995687e13c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:17Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Creating volume 2dc0239d-f241-41ae-974a-8995687e13c5 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:20 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:21 devstack sudo[85626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5 1073741824
Apr 15 23:20:21 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:21 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-25d39e65-8b1f-41fa-bc13-affb5bc9381b tempest-SnapshotsActionsTest-1837188190 None] Create snapshot completed successfully
Apr 15 23:20:21 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5 1073741824" returned: 0 in 0.491s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:21 devstack sudo[85631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5
Apr 15 23:20:21 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:21 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.886s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768358239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bb1dcb-ce37-403d-97cc-3692c6cb2ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:17Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Creating volume 97bb1dcb-ce37-403d-97cc-3692c6cb2ded {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:21 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9394752-aa65-4a91-98d7-27b22c77da71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc0239d-f241-41ae-974a-8995687e13c5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:21 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded 1073741824
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab34fb0c-baae-41f2-94aa-65e363bad089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:21 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:21 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Volume volume-2dc0239d-f241-41ae-974a-8995687e13c5 (2dc0239d-f241-41ae-974a-8995687e13c5): created successfully
Apr 15 23:20:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab34fb0c-baae-41f2-94aa-65e363bad089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (f736feeb-43e5-4ca0-85c3-6623bfd16b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:22 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-706883ce-51de-4429-b9a0-0a56381bdb6d tempest-CreateVolumesFromImageTest-1185681056 None] Created volume successfully.
Apr 15 23:20:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:22 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded 1073741824" returned: 0 in 0.572s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:22 devstack sudo[85639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded
Apr 15 23:20:22 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:22 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded" returned: 0 in 0.450s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.848s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1401151279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98ef806-1d70-495d-9b29-342f67796277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:17Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Creating volume b98ef806-1d70-495d-9b29-342f67796277 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:23 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533037be-2164-4c59-95fe-bcfd31ee1059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:23 devstack sudo[85642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277 1073741824
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156e960b-f901-45be-b00c-4fc111185551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:23 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:23 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Volume volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded (97bb1dcb-ce37-403d-97cc-3692c6cb2ded): created successfully
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156e960b-f901-45be-b00c-4fc111185551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (7e9a5efc-d898-4bce-8105-3339bb8ded29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:23 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8401a5f3-d673-4941-8fef-2dd1030132b2 tempest-CreateVolumesFromImageTest-1185681056 None] Created volume successfully.
Apr 15 23:20:23 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277 1073741824" returned: 0 in 0.547s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:23 devstack sudo[85647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277
Apr 15 23:20:23 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:24 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.620s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128734296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e974e7-8703-4309-a8b8-b9544bab2e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49c66ea3b440084a210417288cb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:17Z,use_quota=True,user_id='ee5c94effa4f463f885560de2b9d3247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Creating volume 38e974e7-8703-4309-a8b8-b9544bab2e31 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:24 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31985dca-4a14-4cc7-94e3-fd27e91a04b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98ef806-1d70-495d-9b29-342f67796277', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:24 devstack sudo[85650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31 1073741824
Apr 15 23:20:24 devstack sudo[85650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f167db55-6e53-4db0-b9d5-35592d22f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:24 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Volume volume-b98ef806-1d70-495d-9b29-342f67796277 (b98ef806-1d70-495d-9b29-342f67796277): created successfully
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f167db55-6e53-4db0-b9d5-35592d22f005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (d20185f3-51a7-4f48-b6e9-480db09dea69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:24 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6de5e32a-d6d7-4cec-a7d1-2cf3926eedc1 tempest-CreateVolumesFromImageTest-1185681056 None] Created volume successfully.
Apr 15 23:20:24 devstack sudo[85650]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31 1073741824" returned: 0 in 0.477s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:24 devstack sudo[85655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31
Apr 15 23:20:24 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:25 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31" returned: 0 in 0.454s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.898s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a76ad7f-9389-4bae-b87e-8b953e78a438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e974e7-8703-4309-a8b8-b9544bab2e31', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67048c8-4602-4638-b258-5f86b84d7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[925e6939-12c6-4a46-ae8e-7cd7b27710f1]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:25 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Volume volume-38e974e7-8703-4309-a8b8-b9544bab2e31 (38e974e7-8703-4309-a8b8-b9544bab2e31): created successfully
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67048c8-4602-4638-b258-5f86b84d7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Flow 'volume_create_manager' (3934e503-bee0-4dcc-8be0-6d19aa82a8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:25 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d5cf9ecf-bd62-4915-8707-d9098c044c79 tempest-CreateVolumesFromImageTest-1185681056 None] Created volume successfully.
Apr 15 23:20:25 devstack sudo[85658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:25 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:25 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 0 in 0.481s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:25 devstack sudo[85663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:25 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:26 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 1 in 0.493s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.009s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.283s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1271587685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e61475-fe4a-4077-9000-f6ef47911efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9a5d0744954644bdfbc0675b177943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:21Z,use_quota=True,user_id='f44e7ff35b7f482aa5c928acfab44adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be24bd3b-afa6-4d94-b579-a3978b89fe2c),volume_type_id=be24bd3b-afa6-4d94-b579-a3978b89fe2c)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Creating volume 21e61475-fe4a-4077-9000-f6ef47911efe {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:26 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:26 devstack sudo[85668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe 1073741824
Apr 15 23:20:26 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31', 'name': 'volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52181467-2090-408c-acab-4d0c8b4a11ea', 'enforce_multipath': True} {{(pid=81941) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-38e974e7-8703-4309-a8b8-b9544bab2e31-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-38e974e7-8703-4309-a8b8-b9544bab2e31-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:26 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-96ffff84-3eaa-4395-b269-c793b929728a req-12bdff01-2aff-4823-8f76-32a8b750f85a tempest-ServerBootFromVolumeStableRescueTest-477629404 None] attachment_update completed successfully.
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-quobyte-38e974e7-8703-4309-a8b8-b9544bab2e31" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-38e974e7-8703-4309-a8b8-b9544bab2e31" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff9319-f536-4dad-bf30-086b6772c864]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:26 devstack sudo[85670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31
Apr 15 23:20:26 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:26 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe 1073741824" returned: 0 in 0.508s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:26 devstack sudo[85675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe
Apr 15 23:20:26 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:26 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31" returned: 0 in 0.523s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:26 devstack sudo[85680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31
Apr 15 23:20:26 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:26 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe" returned: 0 in 0.414s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.607s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f329566-b521-48fb-a76c-b1e5c033ff24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e61475-fe4a-4077-9000-f6ef47911efe', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847cccc1-c75d-4f12-9419-332e79fa99e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Creating offline snapshot 5d1657f7-0741-4d74-9442-8417566ee45b of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aa9f12-8a7b-459b-a24a-61f1cf04b7ce]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:27 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Volume volume-21e61475-fe4a-4077-9000-f6ef47911efe (21e61475-fe4a-4077-9000-f6ef47911efe): created successfully
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847cccc1-c75d-4f12-9419-332e79fa99e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Flow 'volume_create_manager' (78858aaf-91e5-4013-b15d-334fe14627c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:27 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-624eb731-1852-403f-a6e4-41fe202cc94c tempest-VolumeTypesAccessTest-292258092 None] Created volume successfully.
Apr 15 23:20:27 devstack sudo[85683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:27 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:27 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38e974e7-8703-4309-a8b8-b9544bab2e31" returned: 0 in 0.433s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-38e974e7-8703-4309-a8b8-b9544bab2e31" released by "delete_volume" :: held 0.977s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Created reservations ['260ce3d9-f4e8-4e98-b698-50808cdd8695', '78c91a69-84e0-46ae-bddb-5f11e3b3c6c0', 'ce0663e4-b470-47c3-8378-7c1de1ed43b1', 'c4b13491-0a46-4c29-95dc-88556268700b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:27 devstack sudo[85686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:27 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:27 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.525s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:27 devstack sudo[85691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b 1G
Apr 15 23:20:27 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:27 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.390s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:27 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Deleted volume successfully.
Apr 15 23:20:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dcf1b6b0-7d9a-408e-98b3-a89a5bf9d915 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-38e974e7-8703-4309-a8b8-b9544bab2e31-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:28 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b 1G" returned: 0 in 0.493s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:28 devstack sudo[85697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b
Apr 15 23:20:28 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Acquiring lock "cinder-21e61475-fe4a-4077-9000-f6ef47911efe-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Lock "cinder-21e61475-fe4a-4077-9000-f6ef47911efe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Acquiring lock "cinder-quobyte-21e61475-fe4a-4077-9000-f6ef47911efe" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Lock "cinder-quobyte-21e61475-fe4a-4077-9000-f6ef47911efe" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce48a50-724c-4079-bd09-3ef06cf09f7f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:28 devstack sudo[85699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe
Apr 15 23:20:28 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-b98ef806-1d70-495d-9b29-342f67796277-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-b98ef806-1d70-495d-9b29-342f67796277-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-quobyte-b98ef806-1d70-495d-9b29-342f67796277" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-b98ef806-1d70-495d-9b29-342f67796277" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b18ac6e-ef61-4d70-922d-396b3c2cdbc3]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:28 devstack sudo[85701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277
Apr 15 23:20:28 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:28 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b" returned: 0 in 0.474s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:28 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b is being set with open permissions: ugo+rw
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:28 devstack sudo[85706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b
Apr 15 23:20:28 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:28 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe" returned: 0 in 0.573s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:28 devstack sudo[85711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe
Apr 15 23:20:28 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:28 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277" returned: 0 in 0.511s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:28 devstack sudo[85717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277
Apr 15 23:20:28 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:28 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b" returned: 0 in 0.431s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0effed73-eca7-4624-9807-c454ad7029f5 tempest-SnapshotsActionsTest-1837188190 None] Create snapshot completed successfully
Apr 15 23:20:29 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-21e61475-fe4a-4077-9000-f6ef47911efe" returned: 0 in 0.424s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Lock "cinder-quobyte-21e61475-fe4a-4077-9000-f6ef47911efe" released by "delete_volume" :: held 1.020s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:29 devstack cinder-volume[81941]: WARNING cinder.quota [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-981753584 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-981753584, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:20:29 devstack cinder-volume[81941]: WARNING cinder.quota [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-981753584 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-981753584, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Created reservations ['1ae93cd7-8246-4c70-be09-94b658bae8f8', '26249e20-7a95-4005-9aed-eb5522a1d536', '5090bd55-82f1-49e8-b653-39b635b328e8', '21f84ff0-11c0-4e05-a7c8-e395c68e5cff'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:29 devstack sudo[85720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:29 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:29 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b98ef806-1d70-495d-9b29-342f67796277" returned: 0 in 0.427s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-b98ef806-1d70-495d-9b29-342f67796277" released by "delete_volume" :: held 0.969s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Created reservations ['268749b9-eb19-4f17-b252-6d4675c7081e', 'f2cc8c47-b266-46a1-8680-fbdd88d77b55', '205ca2d2-4905-48b0-a347-417055747da2', '5e5ba462-2aec-4e0c-8392-067da4b2a296'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:29 devstack sudo[85726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:29 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-5d1657f7-0741-4d74-9442-8417566ee45b-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-5d1657f7-0741-4d74-9442-8417566ee45b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-quobyte-5d1657f7-0741-4d74-9442-8417566ee45b" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-5d1657f7-0741-4d74-9442-8417566ee45b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Deleting offline snapshot 5d1657f7-0741-4d74-9442-8417566ee45b of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] snapshot_file for this snap is: volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:20:29 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.524s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[17025ea0-b1e2-421d-8a4b-fbd2afe38a3f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:29 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Deleted volume successfully.
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4511311e-4f55-45f0-9cf8-219e015a172a tempest-VolumeTypesAccessTest-292258092 None] Lock "cinder-21e61475-fe4a-4077-9000-f6ef47911efe-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:29 devstack sudo[85729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b
Apr 15 23:20:29 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:29 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.466s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:29 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Deleted volume successfully.
Apr 15 23:20:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e738477-f8db-4d0a-9bf8-7edc010eafb6 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-b98ef806-1d70-495d-9b29-342f67796277-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:30 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b" returned: 0 in 0.474s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e718e9-610f-42b0-8d7f-f7744329b784]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:30 devstack sudo[85735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:30 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-97bb1dcb-ce37-403d-97cc-3692c6cb2ded-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-97bb1dcb-ce37-403d-97cc-3692c6cb2ded-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-quobyte-97bb1dcb-ce37-403d-97cc-3692c6cb2ded" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-97bb1dcb-ce37-403d-97cc-3692c6cb2ded" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e26b0b8-2c12-45cc-812a-0e44738f98ea]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:30 devstack sudo[85737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded
Apr 15 23:20:30 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:30 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.684s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:30 devstack sudo[85758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b
Apr 15 23:20:30 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:31 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded" returned: 0 in 0.703s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:31 devstack sudo[85771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded
Apr 15 23:20:31 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:31 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b" returned: 0 in 0.756s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:31 devstack sudo[85779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b
Apr 15 23:20:31 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:31 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-97bb1dcb-ce37-403d-97cc-3692c6cb2ded" returned: 0 in 0.738s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-97bb1dcb-ce37-403d-97cc-3692c6cb2ded" released by "delete_volume" :: held 1.465s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:DELETE=19,cinder:UPDATE=198,cinder:SELECT=145,cinder:INSERT=49 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Created reservations ['101dd17c-c9e3-4deb-bee4-d349ba38f053', '86642601-293d-4277-896e-65a6eef0c741', '189718fa-74d9-4844-b92b-5b7cabe73b6a', '3e26fa6f-d12c-4ee3-86eb-74eed299e0be'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:32 devstack sudo[85788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:32 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:32 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.5d1657f7-0741-4d74-9442-8417566ee45b" returned: 0 in 0.697s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-5d1657f7-0741-4d74-9442-8417566ee45b" released by "_delete_snapshot" :: held 2.675s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" released by "delete_snapshot" :: held 2.696s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Created reservations ['ffdecd63-eb61-4f98-a9a4-ed4557345e1d', 'c3aebae5-1bd7-4650-966c-9c2c5b3a5c62', 'ed405809-6ac9-47d4-b6a8-1091a302cd93', 'a01660e1-effb-40a9-80f3-4246d87d128a'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:32 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Delete snapshot completed successfully.
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5d90dcb8-449c-4f39-ace8-bdbbdddd751b tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-5d1657f7-0741-4d74-9442-8417566ee45b-delete_snapshot" released by "delete_snapshot" :: held 2.852s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-2dc0239d-f241-41ae-974a-8995687e13c5-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-2dc0239d-f241-41ae-974a-8995687e13c5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-quobyte-2dc0239d-f241-41ae-974a-8995687e13c5" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-2dc0239d-f241-41ae-974a-8995687e13c5" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9da3b8-5d77-42ed-b386-53622aeccccc]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:33 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.856s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:33 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Deleted volume successfully.
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1a328e7a-3e99-4822-b603-8e29faf0d1d2 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-97bb1dcb-ce37-403d-97cc-3692c6cb2ded-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:33 devstack sudo[85791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5
Apr 15 23:20:33 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Creating offline snapshot bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d06dd0-1889-4329-a83d-1be88b0c92e2]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:33 devstack sudo[85794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:33 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:33 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5" returned: 0 in 1.068s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:33 devstack sudo[85800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5
Apr 15 23:20:34 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:34 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.831s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:34 devstack sudo[85805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d 1G
Apr 15 23:20:34 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:34 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dc0239d-f241-41ae-974a-8995687e13c5" returned: 0 in 0.825s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-2dc0239d-f241-41ae-974a-8995687e13c5" released by "delete_volume" :: held 1.937s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Created reservations ['e251fd22-610a-4d6e-a8ed-babe703419e4', '7edf7c12-a8e9-468e-aec1-b2fe021c4412', '1a8eda5b-3a46-418c-8f88-6623955c9101', '2e40c86a-dccc-45a5-b4cc-b987aaf5ed23'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:34 devstack sudo[85813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:34 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-c677f6ab-5ce1-4db9-821f-386a3cc0f375-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-c677f6ab-5ce1-4db9-821f-386a3cc0f375-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "cinder-quobyte-c677f6ab-5ce1-4db9-821f-386a3cc0f375" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:35 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d 1G" returned: 0 in 0.951s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-c677f6ab-5ce1-4db9-821f-386a3cc0f375" acquired by "delete_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:35 devstack sudo[85815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d
Apr 15 23:20:35 devstack sudo[85815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[798361f6-d0db-41d8-8e27-a9563356e7aa]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:35 devstack sudo[85817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375
Apr 15 23:20:35 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:35 devstack sudo[85815]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d" returned: 0 in 0.674s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:35 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d is being set with open permissions: ugo+rw
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:35 devstack sudo[85824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d
Apr 15 23:20:35 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:35 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 1.054s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:35 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Deleted volume successfully.
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da124de9-763f-40a5-bd81-cb89e6967298 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-2dc0239d-f241-41ae-974a-8995687e13c5-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:36 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375" returned: 0 in 1.046s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:36 devstack sudo[85830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375
Apr 15 23:20:36 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:36 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d" returned: 0 in 0.569s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-fbc21e20-2854-49d6-9220-1f8b042cab41 tempest-SnapshotsActionsTest-1837188190 None] Create snapshot completed successfully
Apr 15 23:20:36 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c677f6ab-5ce1-4db9-821f-386a3cc0f375" returned: 0 in 0.593s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-quobyte-c677f6ab-5ce1-4db9-821f-386a3cc0f375" released by "delete_volume" :: held 1.692s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Created reservations ['92f3c4b8-6d98-4934-9a8b-fc8d41a2c53e', '732d41c5-578c-415e-a9a0-8b595950b1f2', '7d1817f6-449f-46be-835c-78b09a32083e', 'c0d79f4d-4504-4141-952f-ff6800841b55'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:36 devstack sudo[85834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:36 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:37 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.502s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:37 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Deleted volume successfully.
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1f5575ad-10d5-4cd2-ae65-22ae9a81ee84 tempest-CreateVolumesFromImageTest-1185681056 None] Lock "cinder-c677f6ab-5ce1-4db9-821f-386a3cc0f375-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" acquired by "delete_snapshot" :: waited 0.041s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-quobyte-bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Deleting offline snapshot bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] snapshot_file for this snap is: volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8d0a9f-91eb-4f7f-a893-7684dade5d88]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:37 devstack sudo[85838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d
Apr 15 23:20:37 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:38 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d" returned: 0 in 0.571s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd4332d-d352-4efa-9794-bc42e1558c9f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:38 devstack sudo[85843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:38 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:38 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.627s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:38 devstack sudo[85854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d
Apr 15 23:20:38 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:39 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d" returned: 0 in 0.752s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:39 devstack sudo[85878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d
Apr 15 23:20:39 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Flow 'volume_create_manager' (26e096bc-b07a-4b02-afbd-ba02c26a047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4184c1a0-b38b-429c-bc18-6aec43338dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4184c1a0-b38b-429c-bc18-6aec43338dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1194a1f6-dc33-4e11-89db-2c5c7027a95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37333a5c9574b30be1a097aa09dd39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:40Z,use_quota=True,user_id='5b4723ce70cc47f686cacf5643d08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c95a7d-7e05-4b3c-8846-ee54ed24411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c95a7d-7e05-4b3c-8846-ee54ed24411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0cad71-bc80-444f-8c3e-f7064875a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0cad71-bc80-444f-8c3e-f7064875a32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1194a1f6-dc33-4e11-89db-2c5c7027a95b', 'volume_name': 'volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c24d200-c69c-4e24-8dcc-f9ec374d7247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c24d200-c69c-4e24-8dcc-f9ec374d7247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d839426-c469-412c-9b4e-7701938d3928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:39 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Volume 1194a1f6-dc33-4e11-89db-2c5c7027a95b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b', 'volume_size': 1}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1194a1f6-dc33-4e11-89db-2c5c7027a95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37333a5c9574b30be1a097aa09dd39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:40Z,use_quota=True,user_id='5b4723ce70cc47f686cacf5643d08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Creating volume 1194a1f6-dc33-4e11-89db-2c5c7027a95b {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:39 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:39 devstack sudo[85880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b 1073741824
Apr 15 23:20:39 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:40 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d" returned: 0 in 0.555s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d" released by "_delete_snapshot" :: held 2.560s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" released by "delete_snapshot" :: held 2.576s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:40 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Created reservations ['3028c1b5-0af3-4230-97af-2a57abad2e83', '1b5d37fa-54b8-4ddb-adab-ff913088dbd3', 'd94ba5d2-8f54-4511-b520-7ac4f3b55627', '3fbb5623-299b-4bbd-b175-643f6e981d55'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Delete snapshot completed successfully.
Apr 15 23:20:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3b000484-daef-4e8b-b177-8ee228beb3f4 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-bc90ff0c-b124-40c2-bf0a-5e1a1eabbf8d-delete_snapshot" released by "delete_snapshot" :: held 2.782s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:40 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b 1073741824" returned: 0 in 0.693s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:40 devstack sudo[85896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b
Apr 15 23:20:40 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:UPDATE=196,cinder:SELECT=169,cinder:DELETE=18,cinder:INSERT=56 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:41 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b" returned: 0 in 0.572s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.090s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Creating offline snapshot 97754aa1-ed0d-42b7-85d8-a67af8a8e034 of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d839426-c469-412c-9b4e-7701938d3928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf34240-4965-4e1e-ac98-837e402b4870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46028b-1bf1-4500-9889-a59373daccad]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Volume volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b (1194a1f6-dc33-4e11-89db-2c5c7027a95b): created successfully
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf34240-4965-4e1e-ac98-837e402b4870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Flow 'volume_create_manager' (26e096bc-b07a-4b02-afbd-ba02c26a047a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b4bc8292-f5d6-4b6a-8ec4-a5a1d2129d21 tempest-CinderUnicodeTest-1190519165 None] Created volume successfully.
Apr 15 23:20:41 devstack sudo[85909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:41 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:41 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.523s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:41 devstack sudo[85948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 1G
Apr 15 23:20:41 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Flow 'volume_create_manager' (6ec58fc5-1c59-401a-93a9-d5f97475122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dc36b0-9221-4552-9bdc-c46e69f53dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dc36b0-9221-4552-9bdc-c46e69f53dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1503712961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3149cf4-2547-4fd1-8aab-fbf4fce86514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37333a5c9574b30be1a097aa09dd39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:42Z,use_quota=True,user_id='5b4723ce70cc47f686cacf5643d08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b31041f-13e9-4963-9f7d-dd52e498fb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b31041f-13e9-4963-9f7d-dd52e498fb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd713ae-2a80-4412-9993-616c7bfa2333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:42 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd713ae-2a80-4412-9993-616c7bfa2333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3149cf4-2547-4fd1-8aab-fbf4fce86514', 'volume_name': 'volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1331dd23-c7d0-466c-9889-9b9072836897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1331dd23-c7d0-466c-9889-9b9072836897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f5a7df-42e7-4806-bb82-1e394e7b7a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:42 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Volume b3149cf4-2547-4fd1-8aab-fbf4fce86514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514', 'volume_size': 1}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 1G" returned: 0 in 0.637s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:42 devstack sudo[85954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034
Apr 15 23:20:42 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:42 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034" returned: 0 in 0.529s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:42 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 is being set with open permissions: ugo+rw
Apr 15 23:20:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:42 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034
Apr 15 23:20:42 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:43 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1503712961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3149cf4-2547-4fd1-8aab-fbf4fce86514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37333a5c9574b30be1a097aa09dd39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:42Z,use_quota=True,user_id='5b4723ce70cc47f686cacf5643d08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Creating volume b3149cf4-2547-4fd1-8aab-fbf4fce86514 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:43 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:43 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2a470ec3-4d27-4fa1-895c-32c1896f17c0 tempest-SnapshotsActionsTest-1837188190 None] Create snapshot completed successfully
Apr 15 23:20:43 devstack sudo[85984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 1073741824
Apr 15 23:20:43 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Flow 'volume_create_manager' (584b1990-9634-498b-a7b4-965aa289205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ebc41a-b7b3-4a8e-b7d3-3128f1271814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ebc41a-b7b3-4a8e-b7d3-3128f1271814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-828197562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584f8aa4-ecf2-46ef-accd-8335bfd53580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e30ac8513954571a1bc6e896ba3a3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:44Z,use_quota=True,user_id='b9095e56689745d8ab9254e5077846e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bb602e-0c4e-4b57-a28e-6c611d7589b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bb602e-0c4e-4b57-a28e-6c611d7589b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a71028-c635-4337-93d5-65a2ba42fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.image.glance [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Creating Keystone auth plugin from conf {{(pid=81941) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a71028-c635-4337-93d5-65a2ba42fe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '584f8aa4-ecf2-46ef-accd-8335bfd53580', 'volume_name': 'volume-584f8aa4-ecf2-46ef-accd-8335bfd53580', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1156008550>}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5835690a-e0f0-44a0-96a0-e6ed8392aa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5835690a-e0f0-44a0-96a0-e6ed8392aa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc63c27-db46-4b58-887f-d6fed196a960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:43 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Volume 584f8aa4-ecf2-46ef-accd-8335bfd53580: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-584f8aa4-ecf2-46ef-accd-8335bfd53580', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1156008550>}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Trying to clone 584f8aa4-ecf2-46ef-accd-8335bfd53580 from image 0e2861bb-d33e-45a3-86bc-d3d94070676e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]). {{(pid=81941) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 23:20:43 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 1073741824" returned: 0 in 0.539s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:44 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514
Apr 15 23:20:44 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 23:20:44 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[225081b7-069b-4865-8f45-5f1bf514b768]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:44 devstack sudo[85993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD
Apr 15 23:20:44 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-97754aa1-ed0d-42b7-85d8-a67af8a8e034-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-97754aa1-ed0d-42b7-85d8-a67af8a8e034-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-quobyte-97754aa1-ed0d-42b7-85d8-a67af8a8e034" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-97754aa1-ed0d-42b7-85d8-a67af8a8e034" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Deleting offline snapshot 97754aa1-ed0d-42b7-85d8-a67af8a8e034 of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] snapshot_file for this snap is: volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[704d98f2-cb23-4048-8521-d7a30edd5eef]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:44 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034
Apr 15 23:20:44 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:44 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f5a7df-42e7-4806-bb82-1e394e7b7a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb07325b-6ba3-4cc0-b49c-2d2760cca7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:44 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Volume volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 (b3149cf4-2547-4fd1-8aab-fbf4fce86514): created successfully
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb07325b-6ba3-4cc0-b49c-2d2760cca7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Flow 'volume_create_manager' (6ec58fc5-1c59-401a-93a9-d5f97475122d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:44 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ac281f20-53bc-44bf-96be-049fe08e008c tempest-CinderUnicodeTest-1190519165 None] Created volume successfully.
Apr 15 23:20:44 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Temporary image 0e2861bb-d33e-45a3-86bc-d3d94070676e is fetched for user b9095e56689745d8ab9254e5077846e8. {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd90d1-1f70-4d69-849b-d07b572cf958]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:44 devstack sudo[86001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD
Apr 15 23:20:44 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:44 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034" returned: 0 in 0.555s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8234fe2b-4b6e-4e4d-9d11-061070d6097e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:44 devstack sudo[86006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:44 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:45 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD" returned: 0 in 0.585s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-828197562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584f8aa4-ecf2-46ef-accd-8335bfd53580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e30ac8513954571a1bc6e896ba3a3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:44Z,use_quota=True,user_id='b9095e56689745d8ab9254e5077846e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Creating volume 584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:20:45 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:45 devstack sudo[86035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 1073741824
Apr 15 23:20:45 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:45 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.654s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:45 devstack sudo[86044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034
Apr 15 23:20:45 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:46 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 1073741824" returned: 0 in 0.812s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:46 devstack sudo[86050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580
Apr 15 23:20:46 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:46 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034" returned: 0 in 0.713s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:46 devstack sudo[86055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034
Apr 15 23:20:46 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:46 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580" returned: 0 in 0.419s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.665s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Attempting download of 0e2861bb-d33e-45a3-86bc-d3d94070676e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}])) to volume 584f8aa4-ecf2-46ef-accd-8335bfd53580. {{(pid=81941) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Creating offline snapshot b60bfef9-3d59-4d67-9474-33041f46c701 of volume b3149cf4-2547-4fd1-8aab-fbf4fce86514 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff84d25-e1b1-4457-9ad7-c5b2fb54f07e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[29400668-ecf4-43fa-bab1-f13846ced7cf]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_kc3ec19v {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:46 devstack sudo[86058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514
Apr 15 23:20:46 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:46 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_kc3ec19v
Apr 15 23:20:46 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:46 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.97754aa1-ed0d-42b7-85d8-a67af8a8e034" returned: 0 in 0.572s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-97754aa1-ed0d-42b7-85d8-a67af8a8e034" released by "_delete_snapshot" :: held 2.545s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" released by "delete_snapshot" :: held 2.564s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Created reservations ['410537ab-6e80-4eb9-a63c-5d0fab8c6dbf', '85e5ade2-6353-4b31-b76b-7ef137f35a1b', '7ad88fb5-90ca-438c-93e0-9924a4f65079', '6139d482-7721-4a7c-a706-6e849b1c6586'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:46 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Delete snapshot completed successfully.
Apr 15 23:20:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2e400001-814f-49e7-8c83-ff7b55a32f73 tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-97754aa1-ed0d-42b7-85d8-a67af8a8e034-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:47 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_kc3ec19v" returned: 0 in 0.549s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_kc3ec19v {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:47 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514" returned: 0 in 0.593s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:47 devstack sudo[86070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 1G
Apr 15 23:20:47 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:47 devstack sudo[86069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_kc3ec19v
Apr 15 23:20:47 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:47 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_kc3ec19v" returned: 1 in 0.664s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_kc3ec19v' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed4134f-d427-4d90-9878-ef06e237c6a6]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:47 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 1G" returned: 0 in 0.721s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:47 devstack sudo[86080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD
Apr 15 23:20:47 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:47 devstack sudo[86081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701
Apr 15 23:20:47 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:48 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:48 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] 0e2861bb-d33e-45a3-86bc-d3d94070676e was qcow2, converting to raw {{(pid=81941) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 23:20:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:48 devstack sudo[86090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580
Apr 15 23:20:48 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:48 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:48 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 is being set with open permissions: ugo+rw
Apr 15 23:20:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:48 devstack sudo[86092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701
Apr 15 23:20:48 devstack sudo[86092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:48 devstack sudo[86092]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701" returned: 0 in 0.409s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:48 devstack sudo[86098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.info
Apr 15 23:20:48 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:49 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.info" returned: 0 in 0.516s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:49 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.info is being set with open permissions: ugo+rw
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:49 devstack sudo[86104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.info
Apr 15 23:20:49 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:49 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580" returned: 0 in 1.043s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_60lanv5tdevstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:20:49 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Converted 112.00 MB image at 107.28 MB/s
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:49 devstack sudo[86106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 1G
Apr 15 23:20:49 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:49 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.info" returned: 0 in 0.527s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:49 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.307s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.137s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 1G" returned: 0 in 0.532s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Creating offline snapshot c2586aca-2323-4b33-ae3e-fc8c20e596f0 of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a489c75c-26b9-4505-98a8-bcb7e7261031]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:49 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-bf585aa6-f3c6-4f28-9f7b-ffbf248b6845 tempest-CinderUnicodeTest-1190519165 None] Create snapshot completed successfully
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b6a94-00d6-4270-a329-2e1aabc6485a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "cinder-b60bfef9-3d59-4d67-9474-33041f46c701-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-b60bfef9-3d59-4d67-9474-33041f46c701-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "cinder-quobyte-b3149cf4-2547-4fd1-8aab-fbf4fce86514" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:50 devstack sudo[86135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580
Apr 15 23:20:50 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:50 devstack sudo[86136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:50 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-quobyte-b3149cf4-2547-4fd1-8aab-fbf4fce86514" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "cinder-quobyte-b60bfef9-3d59-4d67-9474-33041f46c701" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-quobyte-b60bfef9-3d59-4d67-9474-33041f46c701" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Deleting offline snapshot b60bfef9-3d59-4d67-9474-33041f46c701 of volume b3149cf4-2547-4fd1-8aab-fbf4fce86514 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] snapshot_file for this snap is: volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32689ea-fe51-477a-8edb-ff798b677c2a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:50 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701
Apr 15 23:20:50 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:50 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.642s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:50 devstack sudo[86168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 1G
Apr 15 23:20:50 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:50 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580" returned: 0 in 0.732s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:50 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701" returned: 0 in 0.647s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cb4a7e-37db-43b6-8c4f-f05aed754df0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:50 devstack sudo[86173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580
Apr 15 23:20:50 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:50 devstack sudo[86174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514
Apr 15 23:20:50 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:51 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580" returned: 1 in 0.723s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Downloaded image 0e2861bb-d33e-45a3-86bc-d3d94070676e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}])) to volume 584f8aa4-ecf2-46ef-accd-8335bfd53580 successfully. {{(pid=81941) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Temporary image 0e2861bb-d33e-45a3-86bc-d3d94070676e for user b9095e56689745d8ab9254e5077846e8 is deleted. {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Marking volume 584f8aa4-ecf2-46ef-accd-8335bfd53580 as bootable. {{(pid=81941) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Copying metadata from image 0e2861bb-d33e-45a3-86bc-d3d94070676e to 584f8aa4-ecf2-46ef-accd-8335bfd53580. {{(pid=81941) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Creating volume glance metadata for volume 584f8aa4-ecf2-46ef-accd-8335bfd53580 backed by image 0e2861bb-d33e-45a3-86bc-d3d94070676e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81941) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc63c27-db46-4b58-887f-d6fed196a960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584f8aa4-ecf2-46ef-accd-8335bfd53580', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1156008550>}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:51 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d793eb79-0fd6-492c-bf6e-1cd88a9f5781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 1G" returned: 0 in 0.895s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:51 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Volume volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 (584f8aa4-ecf2-46ef-accd-8335bfd53580): created successfully
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d793eb79-0fd6-492c-bf6e-1cd88a9f5781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Flow 'volume_create_manager' (584b1990-9634-498b-a7b4-965aa289205c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:20:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-51098a99-dd4a-43e9-936a-809503c0d54b tempest-VolumesImageMetadata-1695665025 None] Created volume successfully.
Apr 15 23:20:51 devstack sudo[86187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0
Apr 15 23:20:51 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:51 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514" returned: 0 in 0.797s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:51 devstack sudo[86189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701
Apr 15 23:20:51 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:52 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0" returned: 0 in 0.609s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:52 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 is being set with open permissions: ugo+rw
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:52 devstack sudo[86199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0
Apr 15 23:20:52 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:52 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701" returned: 0 in 0.762s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:52 devstack sudo[86201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701
Apr 15 23:20:52 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Acquiring lock "cinder-584f8aa4-ecf2-46ef-accd-8335bfd53580-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Lock "cinder-584f8aa4-ecf2-46ef-accd-8335bfd53580-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Acquiring lock "cinder-quobyte-584f8aa4-ecf2-46ef-accd-8335bfd53580" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Lock "cinder-quobyte-584f8aa4-ecf2-46ef-accd-8335bfd53580" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef8544-78b9-46ed-a57d-af8462faf6d3]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:52 devstack sudo[86204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580
Apr 15 23:20:52 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:52 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0" returned: 0 in 0.680s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:52 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-68f8565d-4066-45de-a6e7-948093af678e tempest-SnapshotsActionsTest-1837188190 None] Create snapshot completed successfully
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-c2586aca-2323-4b33-ae3e-fc8c20e596f0-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-c2586aca-2323-4b33-ae3e-fc8c20e596f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Acquiring lock "cinder-quobyte-c2586aca-2323-4b33-ae3e-fc8c20e596f0" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-c2586aca-2323-4b33-ae3e-fc8c20e596f0" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Deleting offline snapshot c2586aca-2323-4b33-ae3e-fc8c20e596f0 of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:20:53 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] snapshot_file for this snap is: volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514.b60bfef9-3d59-4d67-9474-33041f46c701" returned: 0 in 0.752s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[192080df-accf-4336-af6e-1f42762aacce]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-quobyte-b60bfef9-3d59-4d67-9474-33041f46c701" released by "_delete_snapshot" :: held 3.049s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-quobyte-b3149cf4-2547-4fd1-8aab-fbf4fce86514" released by "delete_snapshot" :: held 3.073s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Created reservations ['f33522c6-fa30-4163-ad02-a747934e6742', '37e46f5c-8125-45f1-b3e0-0a2e0975729c', '2c2bbe48-6abc-4a21-b710-f200f6e1ff6b', '4e8d1e79-d363-4dde-8422-3760059489f8'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:53 devstack sudo[86230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0
Apr 15 23:20:53 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:53 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Delete snapshot completed successfully.
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-940d7452-da0b-4b1a-a39c-ebae594df3f1 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-b60bfef9-3d59-4d67-9474-33041f46c701-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:53 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580" returned: 0 in 0.755s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:53 devstack sudo[86235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580
Apr 15 23:20:53 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:53 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0" returned: 0 in 0.572s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[09abd3e3-d840-43da-9d9e-0fcc981ff5f2]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:53 devstack sudo[86241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:53 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:53 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580" returned: 1 in 0.498s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:20:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:53 devstack sudo[86246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580
Apr 15 23:20:53 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:54 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.516s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:54 devstack sudo[86253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0
Apr 15 23:20:54 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "cinder-b3149cf4-2547-4fd1-8aab-fbf4fce86514-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-b3149cf4-2547-4fd1-8aab-fbf4fce86514-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "cinder-quobyte-b3149cf4-2547-4fd1-8aab-fbf4fce86514" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-quobyte-b3149cf4-2547-4fd1-8aab-fbf4fce86514" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:54 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-584f8aa4-ecf2-46ef-accd-8335bfd53580" returned: 0 in 0.489s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[417cd552-4013-4d62-a6bc-0e0658ddf5f4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Lock "cinder-quobyte-584f8aa4-ecf2-46ef-accd-8335bfd53580" released by "delete_volume" :: held 1.810s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Created reservations ['7356ed1a-4920-495f-be4e-9d8f67be3666', '7410e0b8-040a-4804-a5d1-87ed5bd86e34', '458f6938-49e8-4ed3-9b2a-9d84e0dae423', '0705fdf0-e43f-42de-a8ed-ce846a4e2e95'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:54 devstack sudo[86256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514
Apr 15 23:20:54 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:54 devstack sudo[86258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:54 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:54 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0" returned: 0 in 0.692s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:54 devstack sudo[86268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0
Apr 15 23:20:54 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:55 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514" returned: 0 in 0.592s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:55 devstack sudo[86271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514
Apr 15 23:20:55 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:55 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.568s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Deleted volume successfully.
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4753319c-3aca-46df-9a10-64e8ef9f9f0d tempest-VolumesImageMetadata-1695665025 None] Lock "cinder-584f8aa4-ecf2-46ef-accd-8335bfd53580-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:55 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.c2586aca-2323-4b33-ae3e-fc8c20e596f0" returned: 0 in 0.447s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-c2586aca-2323-4b33-ae3e-fc8c20e596f0" released by "_delete_snapshot" :: held 2.308s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" released by "delete_snapshot" :: held 2.322s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Created reservations ['be94ced9-aa70-459c-b180-bad9846cbc76', 'c3abe52e-27c6-44d9-9d1c-73a762689319', 'ae13f336-3c40-4238-888d-dd2458b0f088', 'ff5ac0c0-2090-4882-af04-63853d9d1873'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Delete snapshot completed successfully.
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4a99b4f0-a28f-4cd6-89a5-f0fdd6b929ca tempest-SnapshotsActionsTest-965228858 None] Lock "cinder-c2586aca-2323-4b33-ae3e-fc8c20e596f0-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:55 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b3149cf4-2547-4fd1-8aab-fbf4fce86514" returned: 0 in 0.578s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-quobyte-b3149cf4-2547-4fd1-8aab-fbf4fce86514" released by "delete_volume" :: held 1.201s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Created reservations ['1a64ddf9-a06a-4e83-8816-37505ea008b1', 'a99dc32f-ca99-4e35-85b8-6c3ebd3a5959', 'f3e463f2-d5d3-41fc-a4de-0d883935b8ae', '98a6e337-0cd1-4e5b-a268-902d3714e529'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-3192ce5c-6892-4f86-ac2d-967b1ffe4632 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Terminate volume connection completed successfully.
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-3192ce5c-6892-4f86-ac2d-967b1ffe4632 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Deleting attachment 52181467-2090-408c-acab-4d0c8b4a11ea. {{(pid=81941) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:55 devstack sudo[86277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:55 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:56 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.435s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:56 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Deleted volume successfully.
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-ba16fa45-ae66-487a-813a-9e00177687f5 tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-b3149cf4-2547-4fd1-8aab-fbf4fce86514-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "cinder-59b5074d-c7aa-4c19-8606-c9c0d9554ac1-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "cinder-59b5074d-c7aa-4c19-8606-c9c0d9554ac1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "cinder-quobyte-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "cinder-quobyte-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" acquired by "delete_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e7bdf-43dd-4f0a-a5db-7aa068299071]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:56 devstack sudo[86280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:56 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "cinder-1194a1f6-dc33-4e11-89db-2c5c7027a95b-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-1194a1f6-dc33-4e11-89db-2c5c7027a95b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "cinder-quobyte-1194a1f6-dc33-4e11-89db-2c5c7027a95b" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-quobyte-1194a1f6-dc33-4e11-89db-2c5c7027a95b" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "cinder-635be015-a98c-4af9-91a5-b3000f66e9d6-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c79806-2f9e-40b1-8367-5d9e7db2dd0a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-635be015-a98c-4af9-91a5-b3000f66e9d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "cinder-quobyte-635be015-a98c-4af9-91a5-b3000f66e9d6" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-quobyte-635be015-a98c-4af9-91a5-b3000f66e9d6" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Deleting offline snapshot 635be015-a98c-4af9-91a5-b3000f66e9d6 of volume 1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] snapshot_file for this snap is: volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[07398b4b-f11f-428e-a7a4-02d76f7dcb12]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:56 devstack sudo[86283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b
Apr 15 23:20:56 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:56 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:56 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:57 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 0 in 0.717s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:57 devstack sudo[86289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:57 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:57 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.562s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:57 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb9d523-9495-4255-9c45-1944ff300a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b" returned: 0 in 0.658s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:57 devstack sudo[86297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:57 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[76299ea9-75c1-4ba1-a21c-458210d0e804]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:57 devstack sudo[86299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b
Apr 15 23:20:57 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:57 devstack sudo[86300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c
Apr 15 23:20:57 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:57 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 1 in 0.691s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:57 devstack sudo[86310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1
Apr 15 23:20:57 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:57 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1194a1f6-dc33-4e11-89db-2c5c7027a95b" returned: 0 in 0.622s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-quobyte-1194a1f6-dc33-4e11-89db-2c5c7027a95b" released by "delete_volume" :: held 1.311s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:57 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c" returned: 0 in 0.632s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:57 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.682s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:57 devstack sudo[86313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:57 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:57 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Created reservations ['489ae5a1-75d0-4329-8058-07851fd221e6', '1634181a-ac02-4c70-88fe-33331196c490', 'd807f54c-feec-4b1e-8e99-6bc0a498c142', 'a742ecb8-0401-49bb-8a7f-f9fd5ef0c817'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:58 devstack sudo[86315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:58 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:58 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" returned: 0 in 0.580s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "cinder-quobyte-59b5074d-c7aa-4c19-8606-c9c0d9554ac1" released by "delete_volume" :: held 2.039s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG cinder.quota [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Created reservations ['0e73b304-e468-4db6-bc0d-755963e0a31c', '8df20095-0c75-4d80-a012-6840e95a9bed', 'c965653b-ec7b-40de-b724-ce3d33d21bcb', '49030f9a-f124-4d0b-b606-dba09b906591'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:58 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.541s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:58 devstack sudo[86322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6
Apr 15 23:20:58 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:20:58 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.507s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:58 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Deleted volume successfully.
Apr 15 23:20:58 devstack sudo[86324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:20:58 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:20:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5ecdf809-7039-48e4-80f0-cf1d1740185b tempest-CinderUnicodeTest-1190519165 None] Lock "cinder-1194a1f6-dc33-4e11-89db-2c5c7027a95b-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:59 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c.635be015-a98c-4af9-91a5-b3000f66e9d6" returned: 0 in 0.642s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:59 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.599s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.manager [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:20:59 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Deleted volume successfully.
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-quobyte-635be015-a98c-4af9-91a5-b3000f66e9d6" released by "_delete_snapshot" :: held 2.475s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" released by "delete_snapshot" :: held 2.492s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-09e78ca6-b8fc-4448-98c3-92cbeb4ed4a7 req-aaf1d5db-e9d0-474e-85b0-bc56111fc1a4 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "cinder-59b5074d-c7aa-4c19-8606-c9c0d9554ac1-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Created reservations ['a3b74d4f-3c7e-4e0c-87e5-7b16862de27b', '9ff4ebc7-b64c-405b-b4c8-9eb39ae9a740', '7ffb3d36-51f7-44bc-a7b3-806808875756', 'eaade377-d5cb-4d7f-b661-8aac10176167'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:20:59 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Delete snapshot completed successfully.
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82339972-9780-4ceb-9eb9-368357e746db tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-635be015-a98c-4af9-91a5-b3000f66e9d6-delete_snapshot" released by "delete_snapshot" :: held 2.616s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "cinder-1cb9d523-9495-4255-9c45-1944ff300a5c-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-1cb9d523-9495-4255-9c45-1944ff300a5c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a80453d-2bb5-453a-8c55-19562bd1e2a6]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:20:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:00 devstack sudo[86329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c
Apr 15 23:21:00 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:00 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c" returned: 0 in 0.647s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:00 devstack sudo[86359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c
Apr 15 23:21:00 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:01 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-1cb9d523-9495-4255-9c45-1944ff300a5c" returned: 0 in 0.553s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-quobyte-1cb9d523-9495-4255-9c45-1944ff300a5c" released by "delete_volume" :: held 1.240s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Created reservations ['c1860ea8-cdf4-4287-b8aa-4159ed327497', 'b0e592b1-e520-4c5f-a72a-b329d2aa6da1', '05862e2d-7217-4ee0-bd43-f9231c1bc496', 'c9cb7120-c3b6-435f-b3f9-4303bdd2fcb4'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:01 devstack sudo[86364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:21:01 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:01 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.589s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:21:01 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Deleted volume successfully.
Apr 15 23:21:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fa2d5692-bc78-4944-b726-11bc1ca5a063 tempest-SnapshotsActionsTest-1837188190 None] Lock "cinder-1cb9d523-9495-4255-9c45-1944ff300a5c-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Flow 'volume_create_manager' (972c5b9d-efde-4a49-ae09-803f11e7bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1af9ab-4ee1-4a09-a7da-c968e49456e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1af9ab-4ee1-4a09-a7da-c968e49456e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1182820803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccf60f2-d6d4-41c8-bb45-68927abfff48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba9e2c6d9e24bcfa237d348aee6e560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:07Z,use_quota=True,user_id='aad7195d7a2e4f898436beddf49a88d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771aae7b-f1d7-4a67-bcb7-74a31ad1b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771aae7b-f1d7-4a67-bcb7-74a31ad1b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15457073-b257-4079-9b47-887fdcf2b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15457073-b257-4079-9b47-887fdcf2b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccf60f2-d6d4-41c8-bb45-68927abfff48', 'volume_name': 'volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e732c30d-83bd-4f88-af60-ff80b9426127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e732c30d-83bd-4f88-af60-ff80b9426127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100cec6d-d862-4345-b8ed-3e68a564d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:06 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Volume 9ccf60f2-d6d4-41c8-bb45-68927abfff48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48', 'volume_size': 1}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1182820803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccf60f2-d6d4-41c8-bb45-68927abfff48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba9e2c6d9e24bcfa237d348aee6e560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:07Z,use_quota=True,user_id='aad7195d7a2e4f898436beddf49a88d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Creating volume 9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:21:06 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:21:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:06 devstack sudo[86372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 1073741824
Apr 15 23:21:06 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:07 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 1073741824" returned: 0 in 0.720s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:07 devstack sudo[86378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:21:07 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:08 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.605s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:21:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100cec6d-d862-4345-b8ed-3e68a564d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e850c3-c3b3-400a-b097-43c11e792eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:08 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Volume volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 (9ccf60f2-d6d4-41c8-bb45-68927abfff48): created successfully
Apr 15 23:21:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e850c3-c3b3-400a-b097-43c11e792eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Flow 'volume_create_manager' (972c5b9d-efde-4a49-ae09-803f11e7bab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:08 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-56a421a8-6356-4416-8742-2003fe0d0cc7 tempest-VolumesActionsTest-2011588541 None] Created volume successfully.
Apr 15 23:21:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-03ec3dd9-27f9-4eba-aa8e-635a512d7b78 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Terminate volume connection completed successfully.
Apr 15 23:21:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-03ec3dd9-27f9-4eba-aa8e-635a512d7b78 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Deleting attachment 9cba97f8-341b-4b68-b4d0-db7a65f4ad19. {{(pid=81941) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 23:21:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "cinder-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "cinder-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "cinder-quobyte-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "cinder-quobyte-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:12 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ecf76f-6c42-48d6-86d6-7dfbcc031bbe]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:12 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f
Apr 15 23:21:12 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:12 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f" returned: 0 in 0.630s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:12 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f
Apr 15 23:21:12 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:13 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f" returned: 0 in 0.412s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "cinder-quobyte-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f" released by "delete_volume" :: held 1.082s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG cinder.quota [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Created reservations ['9bc11829-9276-432f-a7fa-9a24e844d44b', 'fe6f3e0e-d9ec-4e48-9579-d18ade14374c', '1d406903-9689-41b4-a24e-52be094a0d8b', '4943e048-da1a-4371-a861-a0ffe7d3ea8a'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:13 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:21:13 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:13 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.560s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG cinder.manager [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:21:13 devstack cinder-volume[81941]: INFO cinder.volume.manager [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Deleted volume successfully.
Apr 15 23:21:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [req-e56f7324-ce78-4a2c-84eb-c78090335a4b req-0a953dcb-8b95-416a-ad9d-d8deade4d940 tempest-ServerBootFromVolumeStableRescueTest-477629404 None] Lock "cinder-60cdaca6-d4c8-4984-8c9e-89ca0a57e56f-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Flow 'volume_create_manager' (0226ebd2-4415-46c5-8a67-fc56542b02a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec46497-430a-4041-84f9-9e9be5fd6bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec46497-430a-4041-84f9-9e9be5fd6bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-586055293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a36139-0332-4116-914d-94f95fd05303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c52eebc46f4284a8044c8e5f4c30dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:20Z,use_quota=True,user_id='89ca07bbba7f400da7272e60c73406ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35f754d-61b3-4526-9215-17e014a95b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35f754d-61b3-4526-9215-17e014a95b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e39eb17-ae94-47af-a6ae-e27590150015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e39eb17-ae94-47af-a6ae-e27590150015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a36139-0332-4116-914d-94f95fd05303', 'volume_name': 'volume-83a36139-0332-4116-914d-94f95fd05303', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4220cc83-510e-4e75-9249-9fabbe8621e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4220cc83-510e-4e75-9249-9fabbe8621e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9128390-8020-41f2-9269-10d8718cc121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:19 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Volume 83a36139-0332-4116-914d-94f95fd05303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a36139-0332-4116-914d-94f95fd05303', 'volume_size': 1}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-586055293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a36139-0332-4116-914d-94f95fd05303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c52eebc46f4284a8044c8e5f4c30dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:20Z,use_quota=True,user_id='89ca07bbba7f400da7272e60c73406ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Creating volume 83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:21:19 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:21:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:19 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 1073741824
Apr 15 23:21:19 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Flow 'volume_create_manager' (ae7ccdce-3bb5-44c2-9495-60f1467b5be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873a32ae-b798-48ba-98bc-3e7591d97441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873a32ae-b798-48ba-98bc-3e7591d97441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-308395244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f6ab61-d061-4057-9d3d-5e05d4dfac53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cdc90f01b74d58a7f5099708d00408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:20Z,use_quota=True,user_id='514abce575a041438c345e6d5273cb19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52b656f8-9253-481d-bc2e-c43cbef06543),volume_type_id=52b656f8-9253-481d-bc2e-c43cbef06543)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b753490-6de0-4d0d-b84a-c14edc80a9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b753490-6de0-4d0d-b84a-c14edc80a9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27db8b35-97cc-434a-90e1-1d215a6777ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27db8b35-97cc-434a-90e1-1d215a6777ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f6ab61-d061-4057-9d3d-5e05d4dfac53', 'volume_name': 'volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e593018-c066-4381-b81c-98fda7654d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e593018-c066-4381-b81c-98fda7654d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb58463d-98f0-4ea8-9c5e-70a69615451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:20 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Volume e4f6ab61-d061-4057-9d3d-5e05d4dfac53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53', 'volume_size': 1}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:20 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 1073741824" returned: 0 in 0.612s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:20 devstack sudo[86485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303
Apr 15 23:21:20 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:20 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303" returned: 0 in 0.407s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:21:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-308395244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f6ab61-d061-4057-9d3d-5e05d4dfac53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cdc90f01b74d58a7f5099708d00408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:20Z,use_quota=True,user_id='514abce575a041438c345e6d5273cb19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52b656f8-9253-481d-bc2e-c43cbef06543),volume_type_id=52b656f8-9253-481d-bc2e-c43cbef06543)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Creating volume e4f6ab61-d061-4057-9d3d-5e05d4dfac53 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:21:21 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9128390-8020-41f2-9269-10d8718cc121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a36139-0332-4116-914d-94f95fd05303', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23de323-6ebc-42fa-85e6-90aeb8e44897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:21 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53 1073741824
Apr 15 23:21:21 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:21 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Volume volume-83a36139-0332-4116-914d-94f95fd05303 (83a36139-0332-4116-914d-94f95fd05303): created successfully
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23de323-6ebc-42fa-85e6-90aeb8e44897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Flow 'volume_create_manager' (0226ebd2-4415-46c5-8a67-fc56542b02a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:21 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d8ec2fab-3756-4902-9938-6d94d4f6c9ca tempest-SnapshotDependencyTests-1919876872 None] Created volume successfully.
Apr 15 23:21:21 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53 1073741824" returned: 0 in 0.545s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:21 devstack sudo[86515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53
Apr 15 23:21:21 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:22 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53" returned: 0 in 0.495s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb58463d-98f0-4ea8-9c5e-70a69615451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab62c47-b3ee-499c-a1af-9d396261e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:22 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Volume volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53 (e4f6ab61-d061-4057-9d3d-5e05d4dfac53): created successfully
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab62c47-b3ee-499c-a1af-9d396261e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Flow 'volume_create_manager' (ae7ccdce-3bb5-44c2-9495-60f1467b5be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:22 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2d47bdde-45f6-48e6-a215-043407add3f6 tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Created volume successfully.
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Creating offline snapshot c57b4958-5678-447c-8d30-4641f5917e0a of volume 83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[73524f7e-040f-4efa-af21-cd606846e8ba]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:22 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303
Apr 15 23:21:22 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:22 devstack sudo[86523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:21:22 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:22 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303" returned: 0 in 0.532s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:22 devstack sudo[86528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a 1G
Apr 15 23:21:22 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:22 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.487s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:22 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:21:22 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6406a2e6-b4c4-47a3-859d-f4f616f738fb tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Retype volume completed successfully.
Apr 15 23:21:23 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a 1G" returned: 0 in 0.545s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83a36139-0332-4116-914d-94f95fd05303 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:23 devstack sudo[86534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83a36139-0332-4116-914d-94f95fd05303 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a
Apr 15 23:21:23 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Acquiring lock "cinder-e4f6ab61-d061-4057-9d3d-5e05d4dfac53-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "cinder-e4f6ab61-d061-4057-9d3d-5e05d4dfac53-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Acquiring lock "cinder-quobyte-e4f6ab61-d061-4057-9d3d-5e05d4dfac53" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "cinder-quobyte-e4f6ab61-d061-4057-9d3d-5e05d4dfac53" acquired by "delete_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[80105a81-53cf-46c5-bb5a-c89211f196a4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:23 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83a36139-0332-4116-914d-94f95fd05303 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a" returned: 0 in 0.582s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:23 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a is being set with open permissions: ugo+rw
Apr 15 23:21:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:23 devstack sudo[86540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a
Apr 15 23:21:23 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:23 devstack sudo[86539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53
Apr 15 23:21:23 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:24 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53" returned: 0 in 0.547s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:24 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a" returned: 0 in 0.514s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:24 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53
Apr 15 23:21:24 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:24 devstack sudo[86549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.info
Apr 15 23:21:24 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:24 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e4f6ab61-d061-4057-9d3d-5e05d4dfac53" returned: 0 in 0.503s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "cinder-quobyte-e4f6ab61-d061-4057-9d3d-5e05d4dfac53" released by "delete_volume" :: held 1.091s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:24 devstack cinder-volume[81941]: WARNING cinder.quota [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:21:24 devstack cinder-volume[81941]: WARNING cinder.quota [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Created reservations ['d153a8fd-4253-4976-9fc6-c133803f9f0e', 'd3010109-bc8f-4892-9e8c-44c7d0597271', '0d29edf1-303e-433e-827b-dd732cf5744a', 'fba85e4e-b36e-4b76-9a06-e92ff26558c6'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:24 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.info" returned: 0 in 0.593s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:24 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.info is being set with open permissions: ugo+rw
Apr 15 23:21:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:24 devstack sudo[86554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:21:24 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:25 devstack sudo[86555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.info
Apr 15 23:21:25 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:25 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.406s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:25 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:21:25 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Deleted volume successfully.
Apr 15 23:21:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f024afa9-b42a-4305-8c6f-f7f045be844a tempest-VolumeRetypeWithoutMigrationTest-624895947 None] Lock "cinder-e4f6ab61-d061-4057-9d3d-5e05d4dfac53-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:25 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.info" returned: 0 in 0.650s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.486s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:25 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8730b11b-c5e7-4c60-bf9e-92e37f19821a tempest-SnapshotDependencyTests-1919876872 None] Create snapshot completed successfully
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Flow 'volume_create_manager' (4e0bcc0b-87a1-4bf3-bb4a-86a2e7af6b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c2e6ce-01a8-4e8a-8a46-f07fa0a1cc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c2e6ce-01a8-4e8a-8a46-f07fa0a1cc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc25e0f1-d3e6-4d40-9140-d4035c547a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c52eebc46f4284a8044c8e5f4c30dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c57b4958-5678-447c-8d30-4641f5917e0a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:27Z,use_quota=True,user_id='89ca07bbba7f400da7272e60c73406ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e59c52-a65d-4950-93df-c208bc225000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e59c52-a65d-4950-93df-c208bc225000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3e1ae4-fdcc-4bf5-b772-0a08363323b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3e1ae4-fdcc-4bf5-b772-0a08363323b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc25e0f1-d3e6-4d40-9140-d4035c547a4e', 'volume_name': 'volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e', 'volume_size': 1, 'snapshot_id': 'c57b4958-5678-447c-8d30-4641f5917e0a'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e78afc-dd5a-40fb-80a1-12f0eab2abe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e78afc-dd5a-40fb-80a1-12f0eab2abe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef72a6cd-a121-4fdd-932f-d1e78f34a2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:26 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Volume dc25e0f1-d3e6-4d40-9140-d4035c547a4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e', 'volume_size': 1, 'snapshot_id': 'c57b4958-5678-447c-8d30-4641f5917e0a'}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-quobyte-c57b4958-5678-447c-8d30-4641f5917e0a-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" by "_create_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-c57b4958-5678-447c-8d30-4641f5917e0a-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Creating volume dc25e0f1-d3e6-4d40-9140-d4035c547a4e from snapshot c57b4958-5678-447c-8d30-4641f5917e0a {{(pid=81941) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-quobyte-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] snapshot: c57b4958-5678-447c-8d30-4641f5917e0a, volume: dc25e0f1-d3e6-4d40-9140-d4035c547a4e,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[56019f10-2da9-4bb4-abda-cb2b3e507226]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:26 devstack sudo[86564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a
Apr 15 23:21:26 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:27 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a" returned: 0 in 0.585s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83a36139-0332-4116-914d-94f95fd05303(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:21:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:21:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:21:27 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a42a75-8c5d-4f9c-bf7f-2a040e4b02ff]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:27 devstack sudo[86569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303
Apr 15 23:21:27 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:28 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303" returned: 0 in 0.622s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:28 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:21:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:28 devstack sudo[86574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e
Apr 15 23:21:28 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:30 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" returned: 0 in 2.390s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:30 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[68745bfe-1da8-4290-91c4-5d5e973b4aa2]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:30 devstack sudo[86586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303
Apr 15 23:21:30 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:31 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303" returned: 0 in 0.772s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:21:31 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Converted 1024.00 MB image at 428.25 MB/s
Apr 15 23:21:31 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e is being set with open permissions: ugo+rw
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:31 devstack sudo[86591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e
Apr 15 23:21:31 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:31 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" returned: 0 in 0.499s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" released by "_copy_volume_from_snapshot" :: held 4.950s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-c57b4958-5678-447c-8d30-4641f5917e0a-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" released by "_create_volume_from_snapshot" :: held 4.986s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.995s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef72a6cd-a121-4fdd-932f-d1e78f34a2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e', 'volume_size': 1, 'snapshot_id': 'c57b4958-5678-447c-8d30-4641f5917e0a'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32f96c7-b1a0-4741-bdd1-f1f849c50f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:31 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Volume volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e (dc25e0f1-d3e6-4d40-9140-d4035c547a4e): created successfully
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32f96c7-b1a0-4741-bdd1-f1f849c50f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Flow 'volume_create_manager' (4e0bcc0b-87a1-4bf3-bb4a-86a2e7af6b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:31 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-20f3b1ce-4379-4c75-928e-995bda15041a tempest-SnapshotDependencyTests-1919876872 None] Created volume successfully.
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-c57b4958-5678-447c-8d30-4641f5917e0a-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-c57b4958-5678-447c-8d30-4641f5917e0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-quobyte-83a36139-0332-4116-914d-94f95fd05303" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-83a36139-0332-4116-914d-94f95fd05303" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-quobyte-c57b4958-5678-447c-8d30-4641f5917e0a" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-c57b4958-5678-447c-8d30-4641f5917e0a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Deleting offline snapshot c57b4958-5678-447c-8d30-4641f5917e0a of volume 83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] snapshot_file for this snap is: volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d74c5a7-a219-43b8-b384-019c42cde19a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:32 devstack sudo[86601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a
Apr 15 23:21:32 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:33 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a" returned: 0 in 0.865s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83a36139-0332-4116-914d-94f95fd05303(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:21:33 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc17910-ac58-4e0f-b263-ff4e138825da]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:33 devstack sudo[86610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303
Apr 15 23:21:33 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:34 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303" returned: 0 in 0.845s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:34 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a
Apr 15 23:21:34 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d14e7c1-cde7-4f97-92f9-428a28470a38 tempest-VolumesActionsTest-2011588541 None] Acquiring lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48" by "attach_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d14e7c1-cde7-4f97-92f9-428a28470a38 tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48" acquired by "attach_volume" :: waited 0.018s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=146,cinder:UPDATE=144,cinder:INSERT=44,cinder:DELETE=11 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:21:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1d14e7c1-cde7-4f97-92f9-428a28470a38 tempest-VolumesActionsTest-2011588541 None] Attaching volume 9ccf60f2-d6d4-41c8-bb45-68927abfff48 to instance 32926259-739d-4742-9be6-f85c94191c74 at mountpoint /dev/vdb on host None.
Apr 15 23:21:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1d14e7c1-cde7-4f97-92f9-428a28470a38 tempest-VolumesActionsTest-2011588541 None] Attach volume completed successfully.
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d14e7c1-cde7-4f97-92f9-428a28470a38 tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48" released by "attach_volume" :: held 0.155s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:34 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a" returned: 0 in 0.716s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:34 devstack sudo[86621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a
Apr 15 23:21:34 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-af86d249-fab6-4768-b4fd-d70fa5d2072f tempest-VolumesActionsTest-2011588541 None] Acquiring lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-detach_volume" by "detach_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-af86d249-fab6-4768-b4fd-d70fa5d2072f tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-af86d249-fab6-4768-b4fd-d70fa5d2072f tempest-VolumesActionsTest-2011588541 None] Detaching volume 9ccf60f2-d6d4-41c8-bb45-68927abfff48 from instance 32926259-739d-4742-9be6-f85c94191c74.
Apr 15 23:21:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-af86d249-fab6-4768-b4fd-d70fa5d2072f tempest-VolumesActionsTest-2011588541 None] Detach volume completed successfully.
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-af86d249-fab6-4768-b4fd-d70fa5d2072f tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:35 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303.c57b4958-5678-447c-8d30-4641f5917e0a" returned: 0 in 0.742s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-c57b4958-5678-447c-8d30-4641f5917e0a" released by "_delete_snapshot" :: held 3.234s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-83a36139-0332-4116-914d-94f95fd05303" released by "delete_snapshot" :: held 3.256s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Created reservations ['dc4e1ddd-4903-4519-9bc5-ae9bb19055d3', '448c1550-d8a6-427d-82a6-2b8bb49487cc', 'ae80d8dc-b6b5-47ea-8a78-3a20a2af30b5', '3995fe23-da24-45ea-a17d-5030c490558e'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:21:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Delete snapshot completed successfully.
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43e6ae20-0d3f-4818-ba20-bc636ba781ba tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-c57b4958-5678-447c-8d30-4641f5917e0a-delete_snapshot" released by "delete_snapshot" :: held 3.397s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Flow 'volume_create_manager' (459b3237-c84e-463e-8125-ab62a6921355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62141d7-8e28-4516-b747-c18ada95f8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62141d7-8e28-4516-b747-c18ada95f8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1310017868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73e27dd-7fb1-427d-9931-9054e5a372e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b1782236d5421587dbba229ce51f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:36Z,use_quota=True,user_id='c1f1d739db3c4a269cf7c08da65467ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6d89e3-dc5b-47cc-9bbc-1dec11670b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6d89e3-dc5b-47cc-9bbc-1dec11670b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8d34ae-79da-45e8-b142-3f8791d227ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8d34ae-79da-45e8-b142-3f8791d227ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73e27dd-7fb1-427d-9931-9054e5a372e2', 'volume_name': 'volume-f73e27dd-7fb1-427d-9931-9054e5a372e2', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9a4e0c-dc81-46d0-b148-8176bc6a524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9a4e0c-dc81-46d0-b148-8176bc6a524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d9cb56-22da-4b3d-9187-a72563654cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:35 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Volume f73e27dd-7fb1-427d-9931-9054e5a372e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73e27dd-7fb1-427d-9931-9054e5a372e2', 'volume_size': 1}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1310017868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73e27dd-7fb1-427d-9931-9054e5a372e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b1782236d5421587dbba229ce51f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:36Z,use_quota=True,user_id='c1f1d739db3c4a269cf7c08da65467ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Creating volume f73e27dd-7fb1-427d-9931-9054e5a372e2 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:21:35 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:21:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:35 devstack sudo[86626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 1073741824
Apr 15 23:21:35 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:36 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 1073741824" returned: 0 in 0.652s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-83a36139-0332-4116-914d-94f95fd05303-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-83a36139-0332-4116-914d-94f95fd05303-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:36 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2
Apr 15 23:21:36 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-quobyte-83a36139-0332-4116-914d-94f95fd05303" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-83a36139-0332-4116-914d-94f95fd05303" acquired by "delete_volume" :: waited 0.017s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:36 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27aecf1-a933-4a27-9301-88c2ce441401]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:36 devstack sudo[86641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303
Apr 15 23:21:36 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:37 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2" returned: 0 in 0.671s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d9cb56-22da-4b3d-9187-a72563654cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73e27dd-7fb1-427d-9931-9054e5a372e2', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c10213c-a909-4a73-8781-0bb40564d5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:37 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Volume volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 (f73e27dd-7fb1-427d-9931-9054e5a372e2): created successfully
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c10213c-a909-4a73-8781-0bb40564d5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Flow 'volume_create_manager' (459b3237-c84e-463e-8125-ab62a6921355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:37 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-abc7cba5-16c0-4270-9b63-f8a2b0044992 tempest-SnapshotMetadataTestJSON-62566129 None] Created volume successfully.
Apr 15 23:21:37 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303" returned: 0 in 0.694s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:37 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303
Apr 15 23:21:37 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Creating offline snapshot ae4f10fe-1dfd-4999-b306-f393c13ba526 of volume f73e27dd-7fb1-427d-9931-9054e5a372e2 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[16914bc8-f44a-4701-978c-5b2a4119a39a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:38 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83a36139-0332-4116-914d-94f95fd05303" returned: 0 in 0.651s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-83a36139-0332-4116-914d-94f95fd05303" released by "delete_volume" :: held 1.383s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:38 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2
Apr 15 23:21:38 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Created reservations ['c4295493-ce72-478a-ace5-00588d668262', '50bcec2e-ce4e-4492-86d6-4eab5d3aad6a', '28c6bb68-5037-4739-8d3d-5b23518273b1', 'e01aafe3-997b-4203-883d-e59c0a5ba5b3'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:38 devstack sudo[86672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:21:38 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-dc25e0f1-d3e6-4d40-9140-d4035c547a4e-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-dc25e0f1-d3e6-4d40-9140-d4035c547a4e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:38 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2" returned: 0 in 0.707s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "cinder-quobyte-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:38 devstack sudo[86678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 1G
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" acquired by "delete_volume" :: waited 0.042s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:38 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5448f6-205e-483f-b9eb-dfdb71eaae68]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:38 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.592s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:38 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:21:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Deleted volume successfully.
Apr 15 23:21:39 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5e79c05c-e29e-48a0-9b89-7a9fde7c710a tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-83a36139-0332-4116-914d-94f95fd05303-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:39 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e
Apr 15 23:21:39 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:39 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 1G" returned: 0 in 0.606s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:39 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526
Apr 15 23:21:39 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:39 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" returned: 0 in 0.609s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:39 devstack sudo[86696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e
Apr 15 23:21:39 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:40 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" returned: 0 in 0.581s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-quobyte-dc25e0f1-d3e6-4d40-9140-d4035c547a4e" released by "delete_volume" :: held 1.225s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:40 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526" returned: 0 in 0.661s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:40 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 is being set with open permissions: ugo+rw
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:40 devstack sudo[86706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526
Apr 15 23:21:40 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Created reservations ['b480bef4-2a0c-4cde-bd3c-9ece38e18fd3', 'e7d6789f-ee3b-4a12-89f2-d110e8fca639', '67501c1b-f173-41fd-9566-580888f924b0', '8cf6998e-f666-478f-b06e-cdf88ebdf3fb'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:40 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:21:40 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:40 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526" returned: 0 in 0.465s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:40 devstack sudo[86712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.info
Apr 15 23:21:40 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:40 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.493s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:21:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Deleted volume successfully.
Apr 15 23:21:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d238afe4-a8ff-43ad-92d2-cde8f01d12fb tempest-SnapshotDependencyTests-1919876872 None] Lock "cinder-dc25e0f1-d3e6-4d40-9140-d4035c547a4e-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:41 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.info" returned: 0 in 0.494s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:41 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.info is being set with open permissions: ugo+rw
Apr 15 23:21:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:41 devstack sudo[86716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.info
Apr 15 23:21:41 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:41 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.info" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.462s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:41 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:UPDATE=137,cinder:DELETE=8,cinder:SELECT=103,cinder:INSERT=41 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:21:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6154609f-3160-45b0-b623-7be55cbc1f0e tempest-SnapshotMetadataTestJSON-62566129 None] Create snapshot completed successfully
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "cinder-ae4f10fe-1dfd-4999-b306-f393c13ba526-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-ae4f10fe-1dfd-4999-b306-f393c13ba526-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "cinder-quobyte-f73e27dd-7fb1-427d-9931-9054e5a372e2" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-quobyte-f73e27dd-7fb1-427d-9931-9054e5a372e2" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "cinder-quobyte-ae4f10fe-1dfd-4999-b306-f393c13ba526" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-quobyte-ae4f10fe-1dfd-4999-b306-f393c13ba526" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Deleting offline snapshot ae4f10fe-1dfd-4999-b306-f393c13ba526 of volume f73e27dd-7fb1-427d-9931-9054e5a372e2 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] snapshot_file for this snap is: volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219eb6c-140a-42a3-ba1c-0066a93b4da1]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:42 devstack sudo[86755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526
Apr 15 23:21:42 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:43 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526" returned: 0 in 0.651s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f73e27dd-7fb1-427d-9931-9054e5a372e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:21:43 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[907811ca-ceb3-4629-8138-0495722713fa]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:43 devstack sudo[86760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2
Apr 15 23:21:43 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:44 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2" returned: 0 in 0.625s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:44 devstack sudo[86769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526
Apr 15 23:21:44 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:44 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526" returned: 0 in 0.742s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:44 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526
Apr 15 23:21:44 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:45 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2.ae4f10fe-1dfd-4999-b306-f393c13ba526" returned: 0 in 0.558s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-quobyte-ae4f10fe-1dfd-4999-b306-f393c13ba526" released by "_delete_snapshot" :: held 2.644s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-quobyte-f73e27dd-7fb1-427d-9931-9054e5a372e2" released by "delete_snapshot" :: held 2.656s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:45 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Created reservations ['f103b10c-a97d-4592-a845-aba11c46ea89', '47488a91-01d6-4556-a089-649e70ccb067', '8fc723f9-c56f-403b-a142-32ed9dc87589', '8ce94b49-2f9d-4bbe-954d-7d87c9208330'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:21:45 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Delete snapshot completed successfully.
Apr 15 23:21:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-64915cf8-e5b2-4ef8-9b2e-1ca0d055a05b tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-ae4f10fe-1dfd-4999-b306-f393c13ba526-delete_snapshot" released by "delete_snapshot" :: held 2.761s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "cinder-f73e27dd-7fb1-427d-9931-9054e5a372e2-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-f73e27dd-7fb1-427d-9931-9054e5a372e2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "cinder-quobyte-f73e27dd-7fb1-427d-9931-9054e5a372e2" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:21:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-quobyte-f73e27dd-7fb1-427d-9931-9054e5a372e2" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:21:46 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d8e168-8454-4218-921a-3e81dcd67db5]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:46 devstack sudo[86783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2
Apr 15 23:21:46 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:46 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2" returned: 0 in 0.585s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:46 devstack sudo[86802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2
Apr 15 23:21:46 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:47 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f73e27dd-7fb1-427d-9931-9054e5a372e2" returned: 0 in 0.491s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-quobyte-f73e27dd-7fb1-427d-9931-9054e5a372e2" released by "delete_volume" :: held 1.112s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Created reservations ['d872f86c-6d3e-45c3-8b31-918b7dafaf89', '0f957232-bdbc-449a-8217-526eae8c1ae5', '1690f2d4-2ff9-4ddf-8d87-7c9f3666eb87', '34a582a5-6bc0-4ce6-88d2-5fb99cba1ed9'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:47 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:21:47 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:47 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:21:47 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Deleted volume successfully.
Apr 15 23:21:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9acee372-5d79-43e1-bc84-6a6f69a47d3d tempest-SnapshotMetadataTestJSON-62566129 None] Lock "cinder-f73e27dd-7fb1-427d-9931-9054e5a372e2-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Flow 'volume_create_manager' (268dfa56-bc40-4347-9b12-c453ca1f4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d629f51a-61d1-42e7-be39-b51f0fa40da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d629f51a-61d1-42e7-be39-b51f0fa40da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-275141604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedc3fce-b2d1-4d57-8045-5a075f2080f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faebed86e03434c91255b7edaddb7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:50Z,use_quota=True,user_id='7c69fe1ac9ba496d95f5f60aff6d9575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2cb2d4-6d65-44da-bea2-25a21d88ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2cb2d4-6d65-44da-bea2-25a21d88ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ef0456-17c6-48df-a19a-90a6199f32d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ef0456-17c6-48df-a19a-90a6199f32d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedc3fce-b2d1-4d57-8045-5a075f2080f2', 'volume_name': 'volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a11c5d-0740-4fd9-86a4-0c10d780e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a11c5d-0740-4fd9-86a4-0c10d780e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4868d3e-1e72-49a3-a008-81c86f6288f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:50 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Volume cedc3fce-b2d1-4d57-8045-5a075f2080f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2', 'volume_size': 1}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-275141604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedc3fce-b2d1-4d57-8045-5a075f2080f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faebed86e03434c91255b7edaddb7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:50Z,use_quota=True,user_id='7c69fe1ac9ba496d95f5f60aff6d9575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Creating volume cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:21:50 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:21:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:50 devstack sudo[86816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 1073741824
Apr 15 23:21:50 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:51 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 1073741824" returned: 0 in 0.746s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:51 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2
Apr 15 23:21:51 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:51 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2" returned: 0 in 0.620s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4868d3e-1e72-49a3-a008-81c86f6288f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ecb9c1-bdf9-4b60-8c46-1b318d4c0afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:21:51 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Volume volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 (cedc3fce-b2d1-4d57-8045-5a075f2080f2): created successfully
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ecb9c1-bdf9-4b60-8c46-1b318d4c0afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:21:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Flow 'volume_create_manager' (268dfa56-bc40-4347-9b12-c453ca1f4475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:21:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-fa52db03-40ad-43e0-8dcb-9f3c2af40d6b tempest-VolumesDeleteCascade-1891689542 None] Created volume successfully.
Apr 15 23:21:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Creating offline snapshot fc7b8269-530f-470b-babf-e5ac30ddd34e of volume cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:21:52 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[b398f46e-83f9-471d-8b15-ed7aadd4dc91]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:52 devstack sudo[86865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2
Apr 15 23:21:52 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:53 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2" returned: 0 in 0.798s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:53 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e 1G
Apr 15 23:21:53 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:54 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e 1G" returned: 0 in 0.576s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:54 devstack sudo[86890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e
Apr 15 23:21:54 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:54 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e" returned: 0 in 0.576s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:54 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e is being set with open permissions: ugo+rw
Apr 15 23:21:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:54 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e
Apr 15 23:21:54 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:55 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e" returned: 0 in 0.492s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:55 devstack sudo[86904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.info
Apr 15 23:21:55 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:55 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.info" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:55 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.info is being set with open permissions: ugo+rw
Apr 15 23:21:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:55 devstack sudo[86908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.info
Apr 15 23:21:55 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:56 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.info" returned: 0 in 0.619s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.598s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:56 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ed2e21e0-4823-4272-ade7-705ae9c27ac0 tempest-VolumesDeleteCascade-1891689542 None] Create snapshot completed successfully
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Creating offline snapshot 327b4e5d-6e60-4004-8478-19f6ba492a88 of volume cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e8f86-525c-484f-9571-35b66f02c4f8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:57 devstack sudo[86954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e
Apr 15 23:21:57 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:57 devstack sudo[86956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:21:57 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:57 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e" returned: 0 in 0.891s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:21:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:58 devstack sudo[86986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 1G
Apr 15 23:21:58 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:58 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 1.101s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:58 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:21:58 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 1G" returned: 0 in 0.699s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:58 devstack sudo[86995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88
Apr 15 23:21:58 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:59 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88" returned: 0 in 0.549s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:59 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 is being set with open permissions: ugo+rw
Apr 15 23:21:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:21:59 devstack sudo[87001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88
Apr 15 23:21:59 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:21:59 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root
Apr 15 23:21:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88" returned: 0 in 0.551s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:21:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:21:59 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c3a0fada-3f3e-41f8-9bcf-805dc5a785fe tempest-VolumesDeleteCascade-1891689542 None] Create snapshot completed successfully
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-cedc3fce-b2d1-4d57-8045-5a075f2080f2-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-cedc3fce-b2d1-4d57-8045-5a075f2080f2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Performing cascade delete. {{(pid=81941) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-327b4e5d-6e60-4004-8478-19f6ba492a88-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-327b4e5d-6e60-4004-8478-19f6ba492a88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-327b4e5d-6e60-4004-8478-19f6ba492a88" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-327b4e5d-6e60-4004-8478-19f6ba492a88" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Deleting offline snapshot 327b4e5d-6e60-4004-8478-19f6ba492a88 of volume cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] snapshot_file for this snap is: volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de0d21-cf5b-4daa-ac60-687073c5547d]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:00 devstack sudo[87006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88
Apr 15 23:22:00 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:01 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88" returned: 0 in 0.566s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:22:01 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9428ee5-ae56-4c16-982d-d829080688af]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:01 devstack sudo[87011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e
Apr 15 23:22:01 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:01 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e" returned: 0 in 0.654s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:22:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:01 devstack sudo[87016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88
Apr 15 23:22:01 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:02 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88" returned: 0 in 0.899s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-25851790-e5d5-43ad-ab9e-fbe8c31e2ee6 tempest-VolumesActionsTest-2011588541 None] Acquiring lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48" by "attach_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:02 devstack sudo[87027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88
Apr 15 23:22:02 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-25851790-e5d5-43ad-ab9e-fbe8c31e2ee6 tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48" acquired by "attach_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:02 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-25851790-e5d5-43ad-ab9e-fbe8c31e2ee6 tempest-VolumesActionsTest-2011588541 None] Attaching volume 9ccf60f2-d6d4-41c8-bb45-68927abfff48 to instance 04cd232e-9d83-43e1-9bec-5ed1c5e759d9 at mountpoint /dev/vdb on host None.
Apr 15 23:22:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-25851790-e5d5-43ad-ab9e-fbe8c31e2ee6 tempest-VolumesActionsTest-2011588541 None] Attach volume completed successfully.
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-25851790-e5d5-43ad-ab9e-fbe8c31e2ee6 tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48" released by "attach_volume" :: held 0.180s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4bbe9eba-7620-4ac0-a3b0-4e74c6e65bda tempest-VolumesActionsTest-2011588541 None] Acquiring lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-detach_volume" by "detach_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4bbe9eba-7620-4ac0-a3b0-4e74c6e65bda tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4bbe9eba-7620-4ac0-a3b0-4e74c6e65bda tempest-VolumesActionsTest-2011588541 None] Detaching volume 9ccf60f2-d6d4-41c8-bb45-68927abfff48 from instance 04cd232e-9d83-43e1-9bec-5ed1c5e759d9.
Apr 15 23:22:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4bbe9eba-7620-4ac0-a3b0-4e74c6e65bda tempest-VolumesActionsTest-2011588541 None] Detach volume completed successfully.
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4bbe9eba-7620-4ac0-a3b0-4e74c6e65bda tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:03 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.327b4e5d-6e60-4004-8478-19f6ba492a88" returned: 0 in 0.868s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-327b4e5d-6e60-4004-8478-19f6ba492a88" released by "_delete_snapshot" :: held 3.178s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" released by "delete_snapshot" :: held 3.203s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Created reservations ['3685f5ed-6d64-4650-a0a4-8c21a3c619f6', '492684af-9f9c-44fd-8aca-29fae4b7a510', '0dc9c8a4-a970-4260-94dd-fb91bea45b1b', '9ad1e908-211e-465e-a71d-71390414eb06'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Delete snapshot completed successfully.
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-327b4e5d-6e60-4004-8478-19f6ba492a88-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-fc7b8269-530f-470b-babf-e5ac30ddd34e-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-fc7b8269-530f-470b-babf-e5ac30ddd34e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-fc7b8269-530f-470b-babf-e5ac30ddd34e" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-fc7b8269-530f-470b-babf-e5ac30ddd34e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Deleting offline snapshot fc7b8269-530f-470b-babf-e5ac30ddd34e of volume cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] snapshot_file for this snap is: volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0c553f-8d87-4880-a6df-f3962ce6215d]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:03 devstack sudo[87052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e
Apr 15 23:22:03 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:04 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e" returned: 0 in 0.527s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:22:04 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe06970-3d14-4f47-9088-6600b9262d45]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:04 devstack sudo[87064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2
Apr 15 23:22:04 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:04 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2" returned: 0 in 0.585s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:05 devstack sudo[87069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e
Apr 15 23:22:05 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:05 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:05 devstack sudo[87083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e
Apr 15 23:22:05 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:05 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2.fc7b8269-530f-470b-babf-e5ac30ddd34e" returned: 0 in 0.471s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-fc7b8269-530f-470b-babf-e5ac30ddd34e" released by "_delete_snapshot" :: held 2.123s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" released by "delete_snapshot" :: held 2.134s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:05 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Created reservations ['868706aa-dee9-4fce-907e-dec7379f2e69', '00167d9e-9d63-4496-8b9b-0cecba43d053', '18e0f38e-ce06-49a5-be3a-9e5509aaa918', 'ecc0bf3a-75cd-41a7-9207-0d42b7af2344'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:06 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Delete snapshot completed successfully.
Apr 15 23:22:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-fc7b8269-530f-470b-babf-e5ac30ddd34e-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Snapshots deleted, issuing volume delete {{(pid=81941) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 23:22:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:06 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2c0858-51e9-435d-8213-8f4a871a4afe]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:06 devstack sudo[87110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2
Apr 15 23:22:06 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:06 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2" returned: 0 in 0.505s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:06 devstack sudo[87120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2
Apr 15 23:22:06 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:07 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cedc3fce-b2d1-4d57-8045-5a075f2080f2" returned: 0 in 0.516s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-cedc3fce-b2d1-4d57-8045-5a075f2080f2" released by "delete_volume" :: held 1.065s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Created reservations ['81518d28-aa20-4a74-8828-a670534d5465', '8c75dd29-04e4-468e-9190-df7933bc10df', '659cb03b-fdd6-4f4e-9a33-243e0ca9b0f5', 'fa7142fb-42d6-400d-81a7-ee738a2a0e60'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:07 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:22:07 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:07 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.430s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:22:07 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Deleted volume successfully.
Apr 15 23:22:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5377bad0-2317-4aed-a8ac-6fb4691a27ca tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-cedc3fce-b2d1-4d57-8045-5a075f2080f2-delete_volume" released by "delete_volume" :: held 7.275s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Flow 'volume_create_manager' (c3edb550-1711-4670-a708-49a20e25fe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f415fdef-8707-45ec-bfd2-b1fc39fda135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f415fdef-8707-45ec-bfd2-b1fc39fda135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-282141472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed806f84-971a-4494-ad26-ea9a57b3a034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faebed86e03434c91255b7edaddb7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:09Z,use_quota=True,user_id='7c69fe1ac9ba496d95f5f60aff6d9575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0e35d6-a4ad-4a55-ad48-4621f180db4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0e35d6-a4ad-4a55-ad48-4621f180db4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54b22c2-0bca-4cd1-8117-0fafffdb2516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54b22c2-0bca-4cd1-8117-0fafffdb2516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed806f84-971a-4494-ad26-ea9a57b3a034', 'volume_name': 'volume-ed806f84-971a-4494-ad26-ea9a57b3a034', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def88023-274e-4143-acee-c72b57e9bc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def88023-274e-4143-acee-c72b57e9bc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab196d4-7cb1-40db-9de7-f9f3b2ec6c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:08 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Volume ed806f84-971a-4494-ad26-ea9a57b3a034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed806f84-971a-4494-ad26-ea9a57b3a034', 'volume_size': 1}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-282141472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed806f84-971a-4494-ad26-ea9a57b3a034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faebed86e03434c91255b7edaddb7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:09Z,use_quota=True,user_id='7c69fe1ac9ba496d95f5f60aff6d9575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Creating volume ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:22:08 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:22:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:08 devstack sudo[87154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 1073741824
Apr 15 23:22:08 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:09 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 1073741824" returned: 0 in 0.626s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:09 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034
Apr 15 23:22:09 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:09 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034" returned: 0 in 0.626s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab196d4-7cb1-40db-9de7-f9f3b2ec6c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed806f84-971a-4494-ad26-ea9a57b3a034', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738d9e20-7712-4595-a464-67085571d06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:09 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Volume volume-ed806f84-971a-4494-ad26-ea9a57b3a034 (ed806f84-971a-4494-ad26-ea9a57b3a034): created successfully
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738d9e20-7712-4595-a464-67085571d06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Flow 'volume_create_manager' (c3edb550-1711-4670-a708-49a20e25fe5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:10 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-67f6e580-37fd-468c-9f0b-a66ddfd5ee50 tempest-VolumesDeleteCascade-1891689542 None] Created volume successfully.
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Flow 'volume_create_manager' (b1642539-37fa-446b-a713-e280318e389a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc386779-1aba-48d5-959a-54ee8d8cf6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc386779-1aba-48d5-959a-54ee8d8cf6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-93948071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdaf945-ce3b-40ba-8767-d58cbedf6a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cf40b005b3f46fca8a02cfe419d7515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:10Z,use_quota=True,user_id='041526db890e438bb441fafb3ff47b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9e9863-4f52-4a0a-a06b-c66ff161fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9e9863-4f52-4a0a-a06b-c66ff161fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bc25bb-f496-4c08-999e-2f116f2042d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bc25bb-f496-4c08-999e-2f116f2042d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdaf945-ce3b-40ba-8767-d58cbedf6a15', 'volume_name': 'volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb14378-c15d-4835-930d-13b9b120e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb14378-c15d-4835-930d-13b9b120e9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30d8db8-96e9-47ca-8a9e-f4e016505a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:10 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Volume 8fdaf945-ce3b-40ba-8767-d58cbedf6a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15', 'volume_size': 1}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-93948071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdaf945-ce3b-40ba-8767-d58cbedf6a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cf40b005b3f46fca8a02cfe419d7515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:10Z,use_quota=True,user_id='041526db890e438bb441fafb3ff47b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Creating volume 8fdaf945-ce3b-40ba-8767-d58cbedf6a15 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:22:10 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:10 devstack sudo[87164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15 1073741824
Apr 15 23:22:10 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:11 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15 1073741824" returned: 0 in 0.742s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:11 devstack sudo[87169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15
Apr 15 23:22:11 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:11 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15" returned: 0 in 0.538s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.834s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30d8db8-96e9-47ca-8a9e-f4e016505a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7558e69-d558-4849-a2aa-6025a193257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Creating offline snapshot 862003b1-9e8f-45d4-bf54-a6a42207f374 of volume ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:22:11 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Volume volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15 (8fdaf945-ce3b-40ba-8767-d58cbedf6a15): created successfully
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7558e69-d558-4849-a2aa-6025a193257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Flow 'volume_create_manager' (b1642539-37fa-446b-a713-e280318e389a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b46386e-6874-40d5-8e29-37259c1f052e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-89db9cb8-1581-4b05-a118-c0e29cb004e0 tempest-ServerRescueNegativeTestJSON-618807883 None] Created volume successfully.
Apr 15 23:22:11 devstack sudo[87172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034
Apr 15 23:22:11 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:12 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034" returned: 0 in 0.510s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:12 devstack sudo[87177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 1G
Apr 15 23:22:12 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:12 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 1G" returned: 0 in 0.542s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed806f84-971a-4494-ad26-ea9a57b3a034 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:12 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed806f84-971a-4494-ad26-ea9a57b3a034 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374
Apr 15 23:22:12 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:13 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed806f84-971a-4494-ad26-ea9a57b3a034 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374" returned: 0 in 0.470s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:13 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 is being set with open permissions: ugo+rw
Apr 15 23:22:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:13 devstack sudo[87189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374
Apr 15 23:22:13 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:13 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:13 devstack sudo[87197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.info
Apr 15 23:22:13 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:14 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.info" returned: 0 in 0.516s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:14 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.info is being set with open permissions: ugo+rw
Apr 15 23:22:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:14 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.info
Apr 15 23:22:14 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:14 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.info" returned: 0 in 0.465s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.068s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.704s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:14 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207bd88-81c8-439f-99cc-9299596b3523]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:14 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-7ecacade-d233-4e18-ab5b-17f97fde85c8 tempest-VolumesDeleteCascade-1891689542 None] Create snapshot completed successfully
Apr 15 23:22:14 devstack sudo[87208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:22:14 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Flow 'volume_create_manager' (bc3e0b28-6676-4e52-bf2c-395d302e788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a81fb8-6fd0-4b53-bda3-587ccdb1b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a81fb8-6fd0-4b53-bda3-587ccdb1b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-711586862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faebed86e03434c91255b7edaddb7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=862003b1-9e8f-45d4-bf54-a6a42207f374,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:15Z,use_quota=True,user_id='7c69fe1ac9ba496d95f5f60aff6d9575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e00e300-dbc3-44a1-bca6-235f850f46c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e00e300-dbc3-44a1-bca6-235f850f46c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f68f886-105e-4244-a673-468f4abd8ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f68f886-105e-4244-a673-468f4abd8ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899', 'volume_name': 'volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899', 'volume_size': 1, 'snapshot_id': '862003b1-9e8f-45d4-bf54-a6a42207f374'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9db476-eba8-4582-8ee1-66f1dfd45288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9db476-eba8-4582-8ee1-66f1dfd45288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29e9326-26f2-4477-bdb0-df5021b3c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:15 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Volume ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899', 'volume_size': 1, 'snapshot_id': '862003b1-9e8f-45d4-bf54-a6a42207f374'}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:15 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.743s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4acff83-8577-464d-b33c-487e898c9b4b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:15 devstack sudo[87217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:22:15 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:16 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.536s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.a61e7f4f-a98c-4391-91a8-a7a296ace752urdei1iv.img {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:16 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.a61e7f4f-a98c-4391-91a8-a7a296ace752urdei1iv.img
Apr 15 23:22:16 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:18 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.a61e7f4f-a98c-4391-91a8-a7a296ace752urdei1iv.img" returned: 0 in 2.569s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:18 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[76686e94-4074-47d5-8d2e-233bc1008482]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:18 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:22:18 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:19 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.604s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:19 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48, size 1024.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.a61e7f4f-a98c-4391-91a8-a7a296ace752urdei1iv.img {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:22:19 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Converted 1024.00 MB image at 398.29 MB/s
Apr 15 23:22:19 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] a61e7f4f-a98c-4391-91a8-a7a296ace752 was raw, no need to convert to raw {{(pid=81941) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 15 23:22:25 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=60,cinder:UPDATE=54,cinder:INSERT=14,cinder:DELETE=5 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:22:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Acquiring lock "cinder-8fdaf945-ce3b-40ba-8767-d58cbedf6a15-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "cinder-8fdaf945-ce3b-40ba-8767-d58cbedf6a15-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Acquiring lock "cinder-quobyte-8fdaf945-ce3b-40ba-8767-d58cbedf6a15" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "cinder-quobyte-8fdaf945-ce3b-40ba-8767-d58cbedf6a15" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:29 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f32649a-f4ec-455a-8e36-b171e3f9b6a0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:29 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15
Apr 15 23:22:29 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:30 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15" returned: 0 in 0.868s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:30 devstack sudo[87361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15
Apr 15 23:22:30 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:30 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8fdaf945-ce3b-40ba-8767-d58cbedf6a15" returned: 0 in 0.519s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "cinder-quobyte-8fdaf945-ce3b-40ba-8767-d58cbedf6a15" released by "delete_volume" :: held 1.482s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Created reservations ['b13e337f-ab82-46c3-adb8-0c33c31d4241', '8981abb5-ae13-48c3-af7e-1e4940f613c2', '51167a68-b59a-437e-9d84-0c2ae5d4ed34', '9e1a989b-f473-4681-ad7e-04c4645ec13f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.138s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Uploaded volume to glance image-id: a61e7f4f-a98c-4391-91a8-a7a296ace752. {{(pid=81941) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 15.421s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-862003b1-9e8f-45d4-bf54-a6a42207f374-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" by "_create_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:30 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c34e21d4-9f72-450a-b1f4-13dc5437622e tempest-VolumesActionsTest-2011588541 None] Copy volume to image completed successfully.
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-862003b1-9e8f-45d4-bf54-a6a42207f374-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Creating volume ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 from snapshot 862003b1-9e8f-45d4-bf54-a6a42207f374 {{(pid=81941) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] snapshot: 862003b1-9e8f-45d4-bf54-a6a42207f374, volume: ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:22:31 devstack sudo[87364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:22:31 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2028e65-d18d-4764-898b-8b6725fe2652]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:31 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374
Apr 15 23:22:31 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:31 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.447s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:22:31 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Deleted volume successfully.
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d5f3537c-d4fd-4941-97b1-173227412a6e tempest-ServerRescueNegativeTestJSON-618807883 None] Lock "cinder-8fdaf945-ce3b-40ba-8767-d58cbedf6a15-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:31 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374" returned: 0 in 0.504s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed806f84-971a-4494-ad26-ea9a57b3a034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b6a222-facc-4a5d-867c-504e3f3847aa]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:31 devstack sudo[87376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034
Apr 15 23:22:31 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:32 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034" returned: 0 in 0.647s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:32 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:22:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:32 devstack sudo[87410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899
Apr 15 23:22:32 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:35 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" returned: 0 in 2.962s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:35 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91db811-8757-4b11-87ca-ea930fc27047]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:35 devstack sudo[87452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034
Apr 15 23:22:35 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:35 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034" returned: 0 in 0.622s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:35 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034, size 1024.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:22:35 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Converted 1024.00 MB image at 345.61 MB/s
Apr 15 23:22:35 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 is being set with open permissions: ugo+rw
Apr 15 23:22:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:35 devstack sudo[87458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899
Apr 15 23:22:35 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:36 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" returned: 0 in 0.439s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" released by "_copy_volume_from_snapshot" :: held 5.274s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-862003b1-9e8f-45d4-bf54-a6a42207f374-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" released by "_create_volume_from_snapshot" :: held 5.311s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.335s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.669s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a6fc44-957f-478d-a298-35b197e05eae]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=74,cinder:INSERT=21,cinder:UPDATE=83,cinder:DELETE=8 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29e9326-26f2-4477-bdb0-df5021b3c823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899', 'volume_size': 1, 'snapshot_id': '862003b1-9e8f-45d4-bf54-a6a42207f374'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426ac953-1371-4e1b-af2a-7cdfd7e291b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:36 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Volume volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 (ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899): created successfully
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426ac953-1371-4e1b-af2a-7cdfd7e291b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Flow 'volume_create_manager' (bc3e0b28-6676-4e52-bf2c-395d302e788d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-710eb681-c2be-494e-9c94-03171c8ba337 tempest-VolumesDeleteCascade-1891689542 None] Created volume successfully.
Apr 15 23:22:36 devstack sudo[87461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:22:36 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:36 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.551s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea9c4a-cddc-42bb-a7be-954fe8e697f8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:36 devstack sudo[87466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:22:36 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-ed806f84-971a-4494-ad26-ea9a57b3a034-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-ed806f84-971a-4494-ad26-ea9a57b3a034-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Performing cascade delete. {{(pid=81941) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-862003b1-9e8f-45d4-bf54-a6a42207f374-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-862003b1-9e8f-45d4-bf54-a6a42207f374-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-ed806f84-971a-4494-ad26-ea9a57b3a034" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-ed806f84-971a-4494-ad26-ea9a57b3a034" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-862003b1-9e8f-45d4-bf54-a6a42207f374" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-862003b1-9e8f-45d4-bf54-a6a42207f374" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Deleting offline snapshot 862003b1-9e8f-45d4-bf54-a6a42207f374 of volume ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] snapshot_file for this snap is: volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e2b25-9eeb-45ea-95a6-bd318b9c08c1]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:37 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.584s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:37 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img
Apr 15 23:22:37 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:37 devstack sudo[87471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374
Apr 15 23:22:37 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:38 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374" returned: 0 in 0.946s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed806f84-971a-4494-ad26-ea9a57b3a034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:22:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79044df-85ec-49f5-a37e-e5189ccf1c7f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:38 devstack sudo[87488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034
Apr 15 23:22:38 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:40 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034" returned: 0 in 1.988s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:40 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img" returned: 0 in 2.968s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:40 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374
Apr 15 23:22:40 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:40 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8f0855-340d-484e-b8a9-a6ac646a86c4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:40 devstack sudo[87524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:22:40 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:40 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374" returned: 0 in 0.548s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:41 devstack sudo[87534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374
Apr 15 23:22:41 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:41 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.699s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:22:41 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Converted 1024.00 MB image at 344.82 MB/s
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] d62dcfd1-c05e-4bb6-b395-bccd7fc01324 was raw, converting to qcow2 {{(pid=81941) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf8a143-d690-44f8-a79c-2cadff171985]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:41 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img
Apr 15 23:22:41 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:41 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034.862003b1-9e8f-45d4-bf54-a6a42207f374" returned: 0 in 0.447s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-862003b1-9e8f-45d4-bf54-a6a42207f374" released by "_delete_snapshot" :: held 4.005s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-ed806f84-971a-4494-ad26-ea9a57b3a034" released by "delete_snapshot" :: held 4.020s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Created reservations ['ace9a847-800c-4227-9204-0f6131dca466', 'eeabefb9-43d4-43d2-a3d0-7ab4ecebdadf', '7823724a-7005-4f81-887c-17a135737c53', '041aba49-a0db-4600-b1db-51ea96781395'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Delete snapshot completed successfully.
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-862003b1-9e8f-45d4-bf54-a6a42207f374-delete_snapshot" released by "delete_snapshot" :: held 4.120s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Snapshots deleted, issuing volume delete {{(pid=81941) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-ed806f84-971a-4494-ad26-ea9a57b3a034" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-ed806f84-971a-4494-ad26-ea9a57b3a034" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf235c5-e893-4c3a-a537-94a5dca24272]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:41 devstack sudo[87542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034
Apr 15 23:22:41 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:41 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img" returned: 0 in 0.498s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:41 devstack sudo[87546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img
Apr 15 23:22:41 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:42 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034" returned: 0 in 0.543s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:42 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034
Apr 15 23:22:42 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:42 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img" returned: 1 in 0.594s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img /opt/stack/data/cinder/conversion/vol_upload_75wg93tb {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:42 devstack sudo[87591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img /opt/stack/data/cinder/conversion/vol_upload_75wg93tb
Apr 15 23:22:42 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:42 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed806f84-971a-4494-ad26-ea9a57b3a034" returned: 0 in 0.428s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-ed806f84-971a-4494-ad26-ea9a57b3a034" released by "delete_volume" :: held 1.001s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Created reservations ['88c74e67-dfb8-444e-8eba-430004a72721', 'c9ff291d-8e78-412e-84f5-af90d96b961f', '197565db-cbac-48df-939e-66caa9684c51', '54315f63-0bc3-4896-bbe1-28b4c5854c52'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:42 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:22:42 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:42 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img /opt/stack/data/cinder/conversion/vol_upload_75wg93tb" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Image conversion details: src /opt/stack/data/cinder/conversion/9ccf60f2-d6d4-41c8-bb45-68927abfff48.temp_image.d62dcfd1-c05e-4bb6-b395-bccd7fc013246oaqc5dt.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_75wg93tb {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:22:42 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[96774d4b-724c-4ba2-b67a-44401d0170a2]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_75wg93tb {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:42 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_75wg93tb
Apr 15 23:22:42 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:43 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.484s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:43 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Deleted volume successfully.
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6e285f29-8664-4176-90ed-b678652cb781 tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-ed806f84-971a-4494-ad26-ea9a57b3a034-delete_volume" released by "delete_volume" :: held 5.820s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "cinder-quobyte-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb12a922-e31b-4aa3-9463-a8412bd26dbd]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:43 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_75wg93tb" returned: 0 in 0.482s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:43 devstack sudo[87605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899
Apr 15 23:22:43 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:43 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" returned: 0 in 0.557s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:43 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899
Apr 15 23:22:43 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.773s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Uploaded volume to glance image-id: d62dcfd1-c05e-4bb6-b395-bccd7fc01324. {{(pid=81941) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 23:22:44 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-eb8310ed-bacb-4472-8eb6-629dcae82a77 tempest-VolumesActionsTest-2011588541 None] Copy volume to image completed successfully.
Apr 15 23:22:44 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" returned: 0 in 0.435s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-quobyte-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899" released by "delete_volume" :: held 1.016s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Created reservations ['f1f767f5-7e5f-41af-a012-ebd746f15e25', 'b276739c-d75d-41d2-b730-3118a0d97ef5', 'a82ca491-f811-40be-a9bd-9bd59d1b2f34', '92d0958a-8719-4c31-87ce-8a3e5ea6b905'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:44 devstack sudo[87613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:22:44 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:44 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.410s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:22:44 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Deleted volume successfully.
Apr 15 23:22:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-46ba7bbf-0b19-40d1-8d26-617e114d773d tempest-VolumesDeleteCascade-1891689542 None] Lock "cinder-ac3e0b61-d7d5-4f8a-8ac1-43462d1bd899-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Acquiring lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Acquiring lock "cinder-quobyte-9ccf60f2-d6d4-41c8-bb45-68927abfff48" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Lock "cinder-quobyte-9ccf60f2-d6d4-41c8-bb45-68927abfff48" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:45 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e361c0a9-eeb7-442e-a851-5e476f2cbede]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:45 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:22:45 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:46 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.609s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:46 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48
Apr 15 23:22:46 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:46 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9ccf60f2-d6d4-41c8-bb45-68927abfff48" returned: 0 in 0.485s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Lock "cinder-quobyte-9ccf60f2-d6d4-41c8-bb45-68927abfff48" released by "delete_volume" :: held 1.130s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Created reservations ['c1c5b010-01fd-4ec3-b3b3-451c8c470552', '9b8522aa-c6bc-4d2d-8cd2-f54d58ca978c', 'f7f40e8f-2818-4093-aed7-de1b70267711', 'd5f31044-f485-444b-b7c5-f5205f9894aa'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:46 devstack sudo[87626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:22:46 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Flow 'volume_create_manager' (9661e3ce-e3bb-40ee-b0af-50a7da24ea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad2a499-6421-4c3d-b1b1-7dbe3dadfa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad2a499-6421-4c3d-b1b1-7dbe3dadfa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-604527429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92df8ce8-772d-46d7-bf13-eb43dd25d9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d4e250218941ea9cb6040c5c3025dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:47Z,use_quota=True,user_id='5efaeb198f164d318c7ae29b64b3a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd24a840-be0d-4eef-945a-1a6c8dcbad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd24a840-be0d-4eef-945a-1a6c8dcbad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f344dad-e43b-484f-a9b3-6903eea847d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f344dad-e43b-484f-a9b3-6903eea847d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92df8ce8-772d-46d7-bf13-eb43dd25d9d8', 'volume_name': 'volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56ed8f9-20c1-4ab5-b55c-9018843648b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56ed8f9-20c1-4ab5-b55c-9018843648b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671dbdec-6bd0-4fc8-9bcc-d50f7f3f8f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:47 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Volume 92df8ce8-772d-46d7-bf13-eb43dd25d9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8', 'volume_size': 1}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-604527429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92df8ce8-772d-46d7-bf13-eb43dd25d9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d4e250218941ea9cb6040c5c3025dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:47Z,use_quota=True,user_id='5efaeb198f164d318c7ae29b64b3a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Creating volume 92df8ce8-772d-46d7-bf13-eb43dd25d9d8 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:22:47 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:47 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8 1073741824
Apr 15 23:22:47 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:47 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.480s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:22:47 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Deleted volume successfully.
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4480b0ed-9a5f-4492-8161-1ba9e149f143 tempest-VolumesActionsTest-2011588541 None] Lock "cinder-9ccf60f2-d6d4-41c8-bb45-68927abfff48-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:47 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8 1073741824" returned: 0 in 0.604s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:47 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8
Apr 15 23:22:47 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:48 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8" returned: 0 in 0.555s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:22:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671dbdec-6bd0-4fc8-9bcc-d50f7f3f8f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546d4299-8efc-49ac-b35d-501f852e3798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:48 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Volume volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8 (92df8ce8-772d-46d7-bf13-eb43dd25d9d8): created successfully
Apr 15 23:22:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546d4299-8efc-49ac-b35d-501f852e3798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Flow 'volume_create_manager' (9661e3ce-e3bb-40ee-b0af-50a7da24ea0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:48 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-35f405e5-1ac8-4aea-9c67-8aa7f68f688d tempest-VolumesMetadataTest-1525526427 None] Created volume successfully.
Apr 15 23:22:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Acquiring lock "cinder-92df8ce8-772d-46d7-bf13-eb43dd25d9d8-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Lock "cinder-92df8ce8-772d-46d7-bf13-eb43dd25d9d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Acquiring lock "cinder-quobyte-92df8ce8-772d-46d7-bf13-eb43dd25d9d8" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Lock "cinder-quobyte-92df8ce8-772d-46d7-bf13-eb43dd25d9d8" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:49 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[090cc064-fd44-44d2-ba7a-dc4dd1a6b352]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:50 devstack sudo[87639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8
Apr 15 23:22:50 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Flow 'volume_create_manager' (aa7aa93f-fc27-458e-9673-56163b39ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa71bd6-22cf-495d-9542-1a5200ca46cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa71bd6-22cf-495d-9542-1a5200ca46cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-931751344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f46eb58-957f-46f6-b400-01d7ef99356a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d0eb3bf243e438caf9ab8671efefafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:50Z,use_quota=True,user_id='5b6add092e5f45d1a0785a0410f2d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04442ec2-c556-4ba5-bb9c-01becd7db65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04442ec2-c556-4ba5-bb9c-01becd7db65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29298eb3-3248-430e-bd04-7c691790f683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29298eb3-3248-430e-bd04-7c691790f683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f46eb58-957f-46f6-b400-01d7ef99356a', 'volume_name': 'volume-6f46eb58-957f-46f6-b400-01d7ef99356a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b008f6c-6d4d-4706-a258-c7ae7f7d8728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b008f6c-6d4d-4706-a258-c7ae7f7d8728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcda0cfc-b3ea-489c-80d8-ba9ba59a1094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:50 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Volume 6f46eb58-957f-46f6-b400-01d7ef99356a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f46eb58-957f-46f6-b400-01d7ef99356a', 'volume_size': 1}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-931751344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f46eb58-957f-46f6-b400-01d7ef99356a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d0eb3bf243e438caf9ab8671efefafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:50Z,use_quota=True,user_id='5b6add092e5f45d1a0785a0410f2d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Creating volume 6f46eb58-957f-46f6-b400-01d7ef99356a {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:22:50 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:50 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8" returned: 0 in 0.655s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:50 devstack sudo[87645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a 1073741824
Apr 15 23:22:50 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:50 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8
Apr 15 23:22:50 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:51 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92df8ce8-772d-46d7-bf13-eb43dd25d9d8" returned: 0 in 0.530s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Lock "cinder-quobyte-92df8ce8-772d-46d7-bf13-eb43dd25d9d8" released by "delete_volume" :: held 1.214s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:51 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a 1073741824" returned: 0 in 0.580s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Created reservations ['106d43b7-a748-400c-b373-e2443a5cd450', '55ceb9db-a157-4d20-baef-ff34be9b593e', 'b914b6d6-db69-4aa6-bb5c-d66228857e92', '7d019a71-7758-4b96-8430-1663839c2344'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:51 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a
Apr 15 23:22:51 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:51 devstack sudo[87655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:22:51 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:51 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a" returned: 0 in 0.428s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcda0cfc-b3ea-489c-80d8-ba9ba59a1094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f46eb58-957f-46f6-b400-01d7ef99356a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8ad51e-4c44-4870-9f23-a46606f46dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:51 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Volume volume-6f46eb58-957f-46f6-b400-01d7ef99356a (6f46eb58-957f-46f6-b400-01d7ef99356a): created successfully
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8ad51e-4c44-4870-9f23-a46606f46dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Flow 'volume_create_manager' (aa7aa93f-fc27-458e-9673-56163b39ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-7ea0ab09-d0ce-49a0-b68f-9683bb9ac67f tempest-VolumesTestJSON-1895227914 None] Created volume successfully.
Apr 15 23:22:51 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.469s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:22:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Deleted volume successfully.
Apr 15 23:22:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8116b099-911a-41bf-8002-f3a0e136b51a tempest-VolumesMetadataTest-1525526427 None] Lock "cinder-92df8ce8-772d-46d7-bf13-eb43dd25d9d8-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Flow 'volume_create_manager' (14b6a6df-1a22-4567-8501-c54e9916ee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf522f6c-8035-4d21-9a4d-9b4c8d7b8c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf522f6c-8035-4d21-9a4d-9b4c8d7b8c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-939399372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d6c7c8-33d9-42b3-ac8e-e215d89882f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f95d67a48a4633b08de5f2477d07a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:52Z,use_quota=True,user_id='4ed2eb8192ff4d9f9b0ada0d768725cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c6585e-9db9-42a3-a462-7b5ed928db54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c6585e-9db9-42a3-a462-7b5ed928db54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a918e01-7358-4357-87a0-eef907cf3520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a918e01-7358-4357-87a0-eef907cf3520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d6c7c8-33d9-42b3-ac8e-e215d89882f6', 'volume_name': 'volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c21a45-ec95-43ba-a885-16145a2e4c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c21a45-ec95-43ba-a885-16145a2e4c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2d14fd-d8ff-489b-b0b2-56fbde575ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:52 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Volume 39d6c7c8-33d9-42b3-ac8e-e215d89882f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6', 'volume_size': 1}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-939399372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d6c7c8-33d9-42b3-ac8e-e215d89882f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f95d67a48a4633b08de5f2477d07a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:52Z,use_quota=True,user_id='4ed2eb8192ff4d9f9b0ada0d768725cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Creating volume 39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:22:52 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:52 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 1073741824
Apr 15 23:22:52 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:52 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 1073741824" returned: 0 in 0.563s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:52 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6
Apr 15 23:22:52 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Flow 'volume_create_manager' (b9d6c783-34da-4445-9e2a-5588f4bab5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729fe2d0-cde5-4ffb-a77c-291c6fa4b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729fe2d0-cde5-4ffb-a77c-291c6fa4b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-422557935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f870a95-7427-47b3-9002-f7d9bb24b4ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d0eb3bf243e438caf9ab8671efefafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:53Z,use_quota=True,user_id='5b6add092e5f45d1a0785a0410f2d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55fba11-5ccb-4659-a63e-d7f5e2c68f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55fba11-5ccb-4659-a63e-d7f5e2c68f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7b361f-a14b-46d4-b2de-7ec03d75172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7b361f-a14b-46d4-b2de-7ec03d75172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f870a95-7427-47b3-9002-f7d9bb24b4ca', 'volume_name': 'volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f020c742-d769-4f39-a455-f9d8b4b921cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f020c742-d769-4f39-a455-f9d8b4b921cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a884a4-e42b-4bb4-a71b-3fb685e6b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Volume 5f870a95-7427-47b3-9002-f7d9bb24b4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca', 'volume_size': 1}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:53 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" returned: 0 in 0.523s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-422557935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f870a95-7427-47b3-9002-f7d9bb24b4ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d0eb3bf243e438caf9ab8671efefafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:53Z,use_quota=True,user_id='5b6add092e5f45d1a0785a0410f2d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Creating volume 5f870a95-7427-47b3-9002-f7d9bb24b4ca {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:22:53 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2d14fd-d8ff-489b-b0b2-56fbde575ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0a3733-12d0-4d01-b8c4-add32ea8e469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack sudo[87667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca 1073741824
Apr 15 23:22:53 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:53 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Volume volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 (39d6c7c8-33d9-42b3-ac8e-e215d89882f6): created successfully
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0a3733-12d0-4d01-b8c4-add32ea8e469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Flow 'volume_create_manager' (14b6a6df-1a22-4567-8501-c54e9916ee35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:53 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-584d5ed7-e6c4-4dfb-a863-1599d72495cf tempest-VolumesCloneTest-1894762701 None] Created volume successfully.
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Flow 'volume_create_manager' (f0c3ae21-e8af-43e2-accc-5a66f360d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08776ee-19e5-406f-a550-38fb53811488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08776ee-19e5-406f-a550-38fb53811488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-475075384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53b7b18-4d7a-438f-a6dc-8cba06439db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc363790930447c680d9ccc4dc5fcf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:54Z,use_quota=True,user_id='f8d8b0a27b3c45a3b9179d61ad1b4e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dc65ce-bef4-4487-86ce-f72bb6fefc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dc65ce-bef4-4487-86ce-f72bb6fefc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27d96a4-e36e-49ff-ad5b-d86a85de2f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27d96a4-e36e-49ff-ad5b-d86a85de2f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd53b7b18-4d7a-438f-a6dc-8cba06439db6', 'volume_name': 'volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6', 'volume_size': 2}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f2e865-9742-4409-b631-c7c192de5f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f2e865-9742-4409-b631-c7c192de5f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57c5b86-6fd5-4fc2-8c44-9aa85c204d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:53 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Volume d53b7b18-4d7a-438f-a6dc-8cba06439db6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6', 'volume_size': 2}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:53 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca 1073741824" returned: 0 in 0.550s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:53 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca
Apr 15 23:22:53 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:54 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca" returned: 0 in 0.404s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-475075384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53b7b18-4d7a-438f-a6dc-8cba06439db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc363790930447c680d9ccc4dc5fcf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:54Z,use_quota=True,user_id='f8d8b0a27b3c45a3b9179d61ad1b4e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Creating volume d53b7b18-4d7a-438f-a6dc-8cba06439db6 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:22:54 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6 2147483648 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a884a4-e42b-4bb4-a71b-3fb685e6b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966d5494-cd44-4926-ac9f-ae5ad2bb3a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:54 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6 2147483648
Apr 15 23:22:54 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:54 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Volume volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca (5f870a95-7427-47b3-9002-f7d9bb24b4ca): created successfully
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966d5494-cd44-4926-ac9f-ae5ad2bb3a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Flow 'volume_create_manager' (b9d6c783-34da-4445-9e2a-5588f4bab5dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:54 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-08428232-6b8f-4028-8b64-7e5ade4568e5 tempest-VolumesTestJSON-1895227914 None] Created volume successfully.
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Flow 'volume_create_manager' (8af3fdc4-beb5-4eb5-bda8-4d3249b41198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73827da-d8d3-46b3-9edc-e5e574b300fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73827da-d8d3-46b3-9edc-e5e574b300fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-347194187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93aa4ff-5b18-4875-bd94-b6c97613745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f95d67a48a4633b08de5f2477d07a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=39d6c7c8-33d9-42b3-ac8e-e215d89882f6,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:54Z,use_quota=True,user_id='4ed2eb8192ff4d9f9b0ada0d768725cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7846cbc2-2c36-4154-aac1-5eb11f8f1a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7846cbc2-2c36-4154-aac1-5eb11f8f1a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63fa1fd7-d522-4d20-977a-a24e5f68580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63fa1fd7-d522-4d20-977a-a24e5f68580d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd93aa4ff-5b18-4875-bd94-b6c97613745b', 'volume_name': 'volume-d93aa4ff-5b18-4875-bd94-b6c97613745b', 'volume_size': 2, 'source_volid': '39d6c7c8-33d9-42b3-ac8e-e215d89882f6', 'source_volstatus': 'available'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b272670-181c-4190-b751-0466f1e85c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b272670-181c-4190-b751-0466f1e85c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96331323-25f4-4667-a7d6-3e28b6c29a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:54 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Volume d93aa4ff-5b18-4875-bd94-b6c97613745b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d93aa4ff-5b18-4875-bd94-b6c97613745b', 'volume_size': 2, 'source_volid': '39d6c7c8-33d9-42b3-ac8e-e215d89882f6', 'source_volstatus': 'available'}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:54 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6 2147483648" returned: 0 in 0.562s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:54 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6
Apr 15 23:22:54 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:55 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6" returned: 0 in 0.437s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.777s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:55 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Cloning volume 39d6c7c8-33d9-42b3-ac8e-e215d89882f6 to volume d93aa4ff-5b18-4875-bd94-b6c97613745b
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Flow 'volume_create_manager' (fbdf9688-382d-476b-87ba-965d9f23638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15e79ba-0a98-4c71-9aba-2feabb4fcca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15e79ba-0a98-4c71-9aba-2feabb4fcca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1307165197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889f9fee-c453-467c-a46b-794e687db647,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d0eb3bf243e438caf9ab8671efefafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:55Z,use_quota=True,user_id='5b6add092e5f45d1a0785a0410f2d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddbc462-41b7-4598-9673-92d2cb81baf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddbc462-41b7-4598-9673-92d2cb81baf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7df06e8-e0f6-4a00-a936-e67c46057d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7df06e8-e0f6-4a00-a936-e67c46057d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889f9fee-c453-467c-a46b-794e687db647', 'volume_name': 'volume-889f9fee-c453-467c-a46b-794e687db647', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a72805-ae0f-46aa-aa09-4184f611d2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a72805-ae0f-46aa-aa09-4184f611d2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb491b54-1f95-4c3f-b7ba-ae962b23c42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:55 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Volume 889f9fee-c453-467c-a46b-794e687db647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889f9fee-c453-467c-a46b-794e687db647', 'volume_size': 1}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57c5b86-6fd5-4fc2-8c44-9aa85c204d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6', 'volume_size': 2}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a816058-fa7c-4779-bcb2-045fbcc133e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:55 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Volume volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6 (d53b7b18-4d7a-438f-a6dc-8cba06439db6): created successfully
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a816058-fa7c-4779-bcb2-045fbcc133e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Flow 'volume_create_manager' (f0c3ae21-e8af-43e2-accc-5a66f360d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Creating offline snapshot cae63a9c-8d18-4c64-8964-b4a1c9b8f829 of volume 39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:22:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ef5724a0-92cd-4d86-8f5b-a2456661d8f9 tempest-VolumesCloneNegativeTest-534118463 None] Created volume successfully.
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[28608813-f844-40a0-bd4c-b1fa78e01f3f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:55 devstack sudo[87684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6
Apr 15 23:22:55 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:55 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" returned: 0 in 0.500s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:55 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 1G
Apr 15 23:22:55 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Acquiring lock "cinder-d53b7b18-4d7a-438f-a6dc-8cba06439db6-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Lock "cinder-d53b7b18-4d7a-438f-a6dc-8cba06439db6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Acquiring lock "cinder-quobyte-d53b7b18-4d7a-438f-a6dc-8cba06439db6" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Lock "cinder-quobyte-d53b7b18-4d7a-438f-a6dc-8cba06439db6" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c8eda4-a706-4781-b178-154bca8c6b76]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:56 devstack sudo[87691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6
Apr 15 23:22:56 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:56 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 1G" returned: 0 in 0.516s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:56 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829
Apr 15 23:22:56 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:56 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6" returned: 0 in 0.466s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:56 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6
Apr 15 23:22:56 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:56 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829" returned: 0 in 0.432s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:56 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 is being set with open permissions: ugo+rw
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:56 devstack sudo[87708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829
Apr 15 23:22:56 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:56 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d53b7b18-4d7a-438f-a6dc-8cba06439db6" returned: 0 in 0.440s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Lock "cinder-quobyte-d53b7b18-4d7a-438f-a6dc-8cba06439db6" released by "delete_volume" :: held 0.929s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:56 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Created reservations ['04a2ee98-1bbd-44df-a8f6-0e7eebc8c1fb', '117a5aa5-c267-439c-995e-fff95ed10c56', 'f33ef7a6-9635-4674-b582-19638a960cda', '30661ebb-d68a-41bf-86eb-778c37b0466f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:57 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:22:57 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:57 devstack sudo[87712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:22:57 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:57 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829" returned: 0 in 0.479s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:57 devstack sudo[87716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.info
Apr 15 23:22:57 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:57 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.470s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:22:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Deleted volume successfully.
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b93bee08-a7b4-49fe-b564-03473348f9e4 tempest-VolumesCloneNegativeTest-534118463 None] Lock "cinder-d53b7b18-4d7a-438f-a6dc-8cba06439db6-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:22:57 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.485s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:22:57 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.info" returned: 0 in 0.501s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:57 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.info is being set with open permissions: ugo+rw
Apr 15 23:22:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:57 devstack sudo[87720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.info
Apr 15 23:22:57 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:58 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.info" returned: 0 in 0.470s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "cinder-quobyte-d93aa4ff-5b18-4875-bd94-b6c97613745b" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-quobyte-d93aa4ff-5b18-4875-bd94-b6c97613745b" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] snapshot: cae63a9c-8d18-4c64-8964-b4a1c9b8f829, volume: d93aa4ff-5b18-4875-bd94-b6c97613745b,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2804b01b-911d-40b9-af95-71761e7eb1fd]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:58 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829
Apr 15 23:22:58 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (205dfc1b-ffb3-4722-a110-c0a4c6b8124b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987f13dc-b746-4e5c-9060-f82fd8f2e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987f13dc-b746-4e5c-9060-f82fd8f2e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1402268521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:59Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269bd9db-d34b-409a-be27-0c75c3824ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269bd9db-d34b-409a-be27-0c75c3824ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cba0c8b-1758-4866-a5b9-6591a2aba64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cba0c8b-1758-4866-a5b9-6591a2aba64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f', 'volume_name': 'volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3049665b-b9c3-40e6-a983-f9342fa917ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3049665b-b9c3-40e6-a983-f9342fa917ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0ade6b-f373-4d0c-a95c-1c192d7ea781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:22:58 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Volume c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f', 'volume_size': 1}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:22:58 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829" returned: 0 in 0.531s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e9d5b8-3a86-4bfa-a4df-0373b0867da8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:22:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:59 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6
Apr 15 23:22:59 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:22:59 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 15 23:22:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" returned: 0 in 0.471s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:22:59 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:22:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:22:59 devstack sudo[87733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b
Apr 15 23:22:59 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:01 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b" returned: 0 in 1.876s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:01 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88c56c-e2c5-4abc-817b-6272bd394c65]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:01 devstack sudo[87745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6
Apr 15 23:23:01 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:01 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" returned: 0 in 0.578s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:01 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6, size 1024.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:23:01 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Converted 1024.00 MB image at 545.28 MB/s
Apr 15 23:23:01 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b is being set with open permissions: ugo+rw
Apr 15 23:23:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:01 devstack sudo[87750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b
Apr 15 23:23:01 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:02 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b" returned: 0 in 0.444s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-quobyte-d93aa4ff-5b18-4875-bd94-b6c97613745b" released by "_copy_volume_from_snapshot" :: held 3.951s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "cinder-quobyte-cae63a9c-8d18-4c64-8964-b4a1c9b8f829" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-quobyte-cae63a9c-8d18-4c64-8964-b4a1c9b8f829" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Deleting offline snapshot cae63a9c-8d18-4c64-8964-b4a1c9b8f829 of volume 39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] snapshot_file for this snap is: volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fb2fa1-61df-4da0-93b1-9b1390425827]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:02 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829
Apr 15 23:23:02 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:02 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15f8d56-b083-4009-9d4b-8b560e63b113]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:02 devstack sudo[87758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6
Apr 15 23:23:02 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:03 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" returned: 0 in 0.438s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:03 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829
Apr 15 23:23:03 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:03 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829" returned: 0 in 0.419s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:03 devstack sudo[87768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829
Apr 15 23:23:03 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:04 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6.cae63a9c-8d18-4c64-8964-b4a1c9b8f829" returned: 0 in 0.389s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-quobyte-cae63a9c-8d18-4c64-8964-b4a1c9b8f829" released by "_delete_snapshot" :: held 1.746s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.788s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.719s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1307165197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889f9fee-c453-467c-a46b-794e687db647,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d0eb3bf243e438caf9ab8671efefafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:55Z,use_quota=True,user_id='5b6add092e5f45d1a0785a0410f2d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Creating volume 889f9fee-c453-467c-a46b-794e687db647 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:04 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96331323-25f4-4667-a7d6-3e28b6c29a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93aa4ff-5b18-4875-bd94-b6c97613745b', 'volume_size': 2, 'source_volid': '39d6c7c8-33d9-42b3-ac8e-e215d89882f6', 'source_volstatus': 'available'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a95678-39cb-4fa7-871b-6cce6d3040ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:04 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647 1073741824
Apr 15 23:23:04 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:04 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Volume volume-d93aa4ff-5b18-4875-bd94-b6c97613745b (d93aa4ff-5b18-4875-bd94-b6c97613745b): created successfully
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a95678-39cb-4fa7-871b-6cce6d3040ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Flow 'volume_create_manager' (8af3fdc4-beb5-4eb5-bda8-4d3249b41198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:04 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a27f3c31-f33b-4bdd-9dcd-69e8a0558375 tempest-VolumesCloneTest-1894762701 None] Created volume successfully.
Apr 15 23:23:04 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647 1073741824" returned: 0 in 0.465s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:04 devstack sudo[87776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647
Apr 15 23:23:04 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:05 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647" returned: 0 in 0.434s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.151s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1402268521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:59Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Creating volume c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:05 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb491b54-1f95-4c3f-b7ba-ae962b23c42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889f9fee-c453-467c-a46b-794e687db647', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf3728e-499b-48fb-8757-52fe0a0f4e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:05 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f 1073741824
Apr 15 23:23:05 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:05 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Volume volume-889f9fee-c453-467c-a46b-794e687db647 (889f9fee-c453-467c-a46b-794e687db647): created successfully
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf3728e-499b-48fb-8757-52fe0a0f4e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Flow 'volume_create_manager' (fbdf9688-382d-476b-87ba-965d9f23638a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "cinder-d93aa4ff-5b18-4875-bd94-b6c97613745b-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:05 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-15390184-7022-4b4d-971e-2148ec09aa16 tempest-VolumesTestJSON-1895227914 None] Created volume successfully.
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-d93aa4ff-5b18-4875-bd94-b6c97613745b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "cinder-quobyte-d93aa4ff-5b18-4875-bd94-b6c97613745b" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-quobyte-d93aa4ff-5b18-4875-bd94-b6c97613745b" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[603ff5af-5591-4633-b779-656ceff6fcda]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:05 devstack sudo[87781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b
Apr 15 23:23:05 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:05 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f 1073741824" returned: 0 in 0.475s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:05 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f
Apr 15 23:23:05 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:05 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b" returned: 0 in 0.462s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:05 devstack sudo[87792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b
Apr 15 23:23:05 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:05 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f" returned: 0 in 0.410s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0ade6b-f373-4d0c-a95c-1c192d7ea781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4652b7c-fc9d-4d78-a508-07fedbfecd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:06 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Volume volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f (c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f): created successfully
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4652b7c-fc9d-4d78-a508-07fedbfecd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (205dfc1b-ffb3-4722-a110-c0a4c6b8124b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:06 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-16a529cb-5b88-42d2-80ca-e463ef2e1ce3 tempest-VolumesGetTest-1171497064 None] Created volume successfully.
Apr 15 23:23:06 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d93aa4ff-5b18-4875-bd94-b6c97613745b" returned: 0 in 0.414s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-quobyte-d93aa4ff-5b18-4875-bd94-b6c97613745b" released by "delete_volume" :: held 0.916s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Created reservations ['5511f07a-ebf3-42b1-9412-93080f3dbc87', 'e6ad8df2-3e96-45a0-9a84-807d9eec11c0', '190c05fd-9f6f-422e-9477-167633a6beb4', '7be5a335-0907-431a-be3d-0c539dec92db'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:06 devstack sudo[87796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:06 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "cinder-39d6c7c8-33d9-42b3-ac8e-e215d89882f6-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-39d6c7c8-33d9-42b3-ac8e-e215d89882f6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "cinder-quobyte-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-quobyte-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[267d5fdd-64fc-4b32-a630-5274d5198309]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:06 devstack sudo[87798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6
Apr 15 23:23:06 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:06 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.515s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:06 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Deleted volume successfully.
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f753e4c9-959c-4364-aa8d-ceea7aaebeb7 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-d93aa4ff-5b18-4875-bd94-b6c97613745b-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "cinder-889f9fee-c453-467c-a46b-794e687db647-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Lock "cinder-889f9fee-c453-467c-a46b-794e687db647-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (7e7bac32-dc7d-402b-bd57-7fbf50c312ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e57563-6c13-4261-a275-6e5c0e7f7860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e57563-6c13-4261-a275-6e5c0e7f7860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1284136886',display_name='tempest-VolumesGetTest-Volume-859527253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd90b91a-1cbe-47de-affc-b928846e3dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:07Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd968c2-bea1-4bf3-b0b1-4b70e50b0610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd968c2-bea1-4bf3-b0b1-4b70e50b0610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc19e0f-92e4-49ee-bb6f-3b5254f53d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc19e0f-92e4-49ee-bb6f-3b5254f53d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd90b91a-1cbe-47de-affc-b928846e3dfc', 'volume_name': 'volume-fd90b91a-1cbe-47de-affc-b928846e3dfc', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e888bd-01e5-484b-bea0-bf3b90ec1e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e888bd-01e5-484b-bea0-bf3b90ec1e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaeb440d-4195-498f-bd8e-7a0c1d17ac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:06 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Volume fd90b91a-1cbe-47de-affc-b928846e3dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd90b91a-1cbe-47de-affc-b928846e3dfc', 'volume_size': 1}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1284136886',display_name='tempest-VolumesGetTest-Volume-859527253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd90b91a-1cbe-47de-affc-b928846e3dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:07Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Creating volume fd90b91a-1cbe-47de-affc-b928846e3dfc {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:06 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "cinder-quobyte-889f9fee-c453-467c-a46b-794e687db647" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:06 devstack sudo[87801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc 1073741824
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Lock "cinder-quobyte-889f9fee-c453-467c-a46b-794e687db647" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:06 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0819457-d859-4870-b297-cb2121961243]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:06 devstack sudo[87805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647
Apr 15 23:23:06 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:07 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" returned: 0 in 0.588s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:07 devstack sudo[87808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6
Apr 15 23:23:07 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:07 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc 1073741824" returned: 0 in 0.462s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:07 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc
Apr 15 23:23:07 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:07 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647" returned: 0 in 0.479s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:07 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647
Apr 15 23:23:07 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:07 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-quobyte-39d6c7c8-33d9-42b3-ac8e-e215d89882f6" released by "delete_volume" :: held 1.076s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Created reservations ['5608e5ad-3132-432e-99c7-9f0ab3f28e11', '56bc727a-ab3a-462b-ba3b-86d4bf578ad5', '24156b20-8f29-460a-bcf4-29810f78cdbb', '78793149-0be8-404b-a9e3-890e124c1e3f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:07 devstack sudo[87821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:07 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:07 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc" returned: 0 in 0.439s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:07 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-889f9fee-c453-467c-a46b-794e687db647" returned: 0 in 0.425s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaeb440d-4195-498f-bd8e-7a0c1d17ac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd90b91a-1cbe-47de-affc-b928846e3dfc', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c628877-3626-431d-843a-5034f98cf9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Lock "cinder-quobyte-889f9fee-c453-467c-a46b-794e687db647" released by "delete_volume" :: held 0.936s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:07 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Volume volume-fd90b91a-1cbe-47de-affc-b928846e3dfc (fd90b91a-1cbe-47de-affc-b928846e3dfc): created successfully
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c628877-3626-431d-843a-5034f98cf9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (7e7bac32-dc7d-402b-bd57-7fbf50c312ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:07 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b6c8d350-8427-4f01-88ce-718d9027721d tempest-VolumesGetTest-1171497064 None] Created volume successfully.
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Created reservations ['bba47bc9-79ae-4645-affe-3e63634ec8fd', '74c631d6-0fb0-48dc-abf6-8e44bbe1fc57', '7b595417-16bf-4a3e-bf78-2f47b64db5a6', '82cd19c5-8702-475f-bca7-cd7a5595c3eb'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:07 devstack sudo[87826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:07 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:07 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.434s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:07 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Deleted volume successfully.
Apr 15 23:23:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3780ace6-5178-4fcd-9226-63f6445645f3 tempest-VolumesCloneTest-1894762701 None] Lock "cinder-39d6c7c8-33d9-42b3-ac8e-e215d89882f6-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:08 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.396s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:08 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:08 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Deleted volume successfully.
Apr 15 23:23:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b14ba99d-e49e-457b-93d6-7ea3b91293a5 tempest-VolumesTestJSON-1895227914 None] Lock "cinder-889f9fee-c453-467c-a46b-794e687db647-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "cinder-5f870a95-7427-47b3-9002-f7d9bb24b4ca-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Lock "cinder-5f870a95-7427-47b3-9002-f7d9bb24b4ca-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "cinder-quobyte-5f870a95-7427-47b3-9002-f7d9bb24b4ca" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-fd90b91a-1cbe-47de-affc-b928846e3dfc-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Lock "cinder-quobyte-5f870a95-7427-47b3-9002-f7d9bb24b4ca" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Lock "cinder-fd90b91a-1cbe-47de-affc-b928846e3dfc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b037a4f-1595-410e-9573-71a382eaf080]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-fd90b91a-1cbe-47de-affc-b928846e3dfc" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-fd90b91a-1cbe-47de-affc-b928846e3dfc" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e41b3dd-a331-445e-b548-85579869678a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:09 devstack sudo[87829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca
Apr 15 23:23:09 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:09 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc
Apr 15 23:23:09 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:09 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca" returned: 0 in 0.546s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:09 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc" returned: 0 in 0.505s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:09 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca
Apr 15 23:23:09 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:09 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc
Apr 15 23:23:09 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:10 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5f870a95-7427-47b3-9002-f7d9bb24b4ca" returned: 0 in 0.471s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Lock "cinder-quobyte-5f870a95-7427-47b3-9002-f7d9bb24b4ca" released by "delete_volume" :: held 1.055s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:10 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fd90b91a-1cbe-47de-affc-b928846e3dfc" returned: 0 in 0.481s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-fd90b91a-1cbe-47de-affc-b928846e3dfc" released by "delete_volume" :: held 1.013s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Created reservations ['475e7eb2-63b3-4a3f-99f9-7c43c728272e', '5b874e0e-9828-4dd2-815e-3b0fa4365836', 'e93ff454-4383-42ce-b3ca-8d9d50621144', '6c1e5948-62f6-440b-b9b9-46de22dc4e38'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Created reservations ['d04ba729-55cd-44fc-b936-9977e9038efe', '03c14647-18e9-4398-9d9d-abe5f309361b', '74aaad63-3b67-45af-a829-b3af0be8fbc3', '3a80cfa6-c3c5-4450-8811-8f17cbaded5c'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:10 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:10 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:10 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:10 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Flow 'volume_create_manager' (87da1028-d90c-448a-b9b7-0893d471f435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7cb44f-3082-4309-a0a0-06f9413693ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7cb44f-3082-4309-a0a0-06f9413693ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-246749302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfaf15f-f177-4bb8-8618-5fd4a0597d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b73adaae1e4775bb708728f92cb18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:10Z,use_quota=True,user_id='5faf0caafbb74a7891c0d34bde893d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0163cda-acac-40a8-8741-6f93dc4e42bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0163cda-acac-40a8-8741-6f93dc4e42bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477a66d2-cfb6-498c-b559-92d4325df439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477a66d2-cfb6-498c-b559-92d4325df439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bfaf15f-f177-4bb8-8618-5fd4a0597d97', 'volume_name': 'volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fed4c9b-9fd9-48db-9463-a644d0e5d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fed4c9b-9fd9-48db-9463-a644d0e5d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56ca7a3-9344-42df-8081-ef3777fc7362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:10 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Volume 2bfaf15f-f177-4bb8-8618-5fd4a0597d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97', 'volume_size': 1}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-246749302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfaf15f-f177-4bb8-8618-5fd4a0597d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b73adaae1e4775bb708728f92cb18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:10Z,use_quota=True,user_id='5faf0caafbb74a7891c0d34bde893d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Creating volume 2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:10 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:10 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 1073741824
Apr 15 23:23:10 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:10 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.460s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:10 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Deleted volume successfully.
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8f0f18d2-9c5d-475c-8f7a-a58dae415530 tempest-VolumesTestJSON-1895227914 None] Lock "cinder-5f870a95-7427-47b3-9002-f7d9bb24b4ca-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:10 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.429s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:10 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Deleted volume successfully.
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-abf476b7-7320-4443-8e7c-d6fd5dc8b94f tempest-VolumesGetTest-1171497064 None] Lock "cinder-fd90b91a-1cbe-47de-affc-b928846e3dfc-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:10 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 1073741824" returned: 0 in 0.505s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:10 devstack sudo[87857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97
Apr 15 23:23:10 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Acquiring lock "cinder-6f46eb58-957f-46f6-b400-01d7ef99356a-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Lock "cinder-6f46eb58-957f-46f6-b400-01d7ef99356a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Acquiring lock "cinder-quobyte-6f46eb58-957f-46f6-b400-01d7ef99356a" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Lock "cinder-quobyte-6f46eb58-957f-46f6-b400-01d7ef99356a" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16b9fb-2f98-4166-bfce-d70c2a190d74]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Lock "cinder-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:11 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" returned: 0 in 0.465s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:11 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a
Apr 15 23:23:11 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56ca7a3-9344-42df-8081-ef3777fc7362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c701e6-2d36-4dc5-b384-f5529b177e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f" acquired by "delete_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3867773-1920-4640-b9d1-2f1fc60c8b30]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:11 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Volume volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 (2bfaf15f-f177-4bb8-8618-5fd4a0597d97): created successfully
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c701e6-2d36-4dc5-b384-f5529b177e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Flow 'volume_create_manager' (87da1028-d90c-448a-b9b7-0893d471f435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-bbe5c4b3-e810-40bc-968b-7795b9e13282 tempest-VolumesSnapshotListTestJSON-1289014534 None] Created volume successfully.
Apr 15 23:23:11 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f
Apr 15 23:23:11 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:11 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a" returned: 0 in 0.495s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:11 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a
Apr 15 23:23:11 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:11 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f" returned: 0 in 0.491s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:11 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f
Apr 15 23:23:11 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:12 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-6f46eb58-957f-46f6-b400-01d7ef99356a" returned: 0 in 0.391s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Lock "cinder-quobyte-6f46eb58-957f-46f6-b400-01d7ef99356a" released by "delete_volume" :: held 0.917s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Created reservations ['a235db2b-55d5-4c16-9631-3194a2fe8e7d', '3a8718b7-fef5-49a0-8351-1f6ac43606b5', '21cd61c7-114c-4bc8-94a7-a8f191e2b1f9', 'c77c5ce5-8145-4c1d-b183-af9f4e9f0a51'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:12 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:12 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:12 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f" returned: 0 in 0.432s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f" released by "delete_volume" :: held 0.954s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Created reservations ['4ac79c87-4404-4758-8969-70b295691801', '093f892b-e16f-4101-b850-8d8ac26ab2b1', 'b5738f90-406c-4bed-b6e0-adc90a240ee1', '3bc04c97-afe9-4776-81a2-ce123faba2e1'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:12 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:12 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Creating offline snapshot 553d5e36-69d9-4b42-a4f4-e1c87684f6d3 of volume 2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b24159-e740-4ad4-b4e8-7df49a1ef197]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:12 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.467s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:12 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Deleted volume successfully.
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-62498eff-143a-467f-8a4e-f3ab355c3f2e tempest-VolumesTestJSON-1895227914 None] Lock "cinder-6f46eb58-957f-46f6-b400-01d7ef99356a-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:12 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97
Apr 15 23:23:12 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:12 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.564s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:12 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:12 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Deleted volume successfully.
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-eb736777-0e1d-4867-b5da-2823dd12028f tempest-VolumesGetTest-1171497064 None] Lock "cinder-c3fcd8d1-2a77-4a9d-a1c5-c4c506de1a4f-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:13 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" returned: 0 in 0.489s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:13 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 1G
Apr 15 23:23:13 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:13 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 1G" returned: 0 in 0.524s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:13 devstack sudo[87893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3
Apr 15 23:23:13 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (f19bd277-4f8b-475d-b54e-a4a3aada3d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4382af00-b609-4afe-af56-c099dc8c8a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4382af00-b609-4afe-af56-c099dc8c8a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-263187995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198292e1-92a7-431f-a9ed-18c2eb637e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:14Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aea4bde-07dd-4a5c-8d1a-2e6c375cea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aea4bde-07dd-4a5c-8d1a-2e6c375cea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35241641-3537-403d-ba28-b1586308f9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35241641-3537-403d-ba28-b1586308f9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '198292e1-92a7-431f-a9ed-18c2eb637e90', 'volume_name': 'volume-198292e1-92a7-431f-a9ed-18c2eb637e90', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9280e2-d4a0-44c0-9fcc-95bba8027fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9280e2-d4a0-44c0-9fcc-95bba8027fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ee3a53-519f-4dd1-8f5c-0c17cd2d85e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:13 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Volume 198292e1-92a7-431f-a9ed-18c2eb637e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-198292e1-92a7-431f-a9ed-18c2eb637e90', 'volume_size': 1}
Apr 15 23:23:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:14 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3" returned: 0 in 0.449s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:14 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 is being set with open permissions: ugo+rw
Apr 15 23:23:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:14 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3
Apr 15 23:23:14 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:14 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3" returned: 0 in 0.430s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:14 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.info
Apr 15 23:23:14 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:15 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.info" returned: 0 in 0.471s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:15 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.info is being set with open permissions: ugo+rw
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:15 devstack sudo[87905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.info
Apr 15 23:23:15 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:15 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.info" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-263187995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198292e1-92a7-431f-a9ed-18c2eb637e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:14Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Creating volume 198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:15 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:15 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 1073741824
Apr 15 23:23:15 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:15 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0bd86f40-4921-4143-ac6c-a068c1714a7c tempest-VolumesSnapshotListTestJSON-1289014534 None] Create snapshot completed successfully
Apr 15 23:23:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:16 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 1073741824" returned: 0 in 0.584s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:16 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90
Apr 15 23:23:16 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:16 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.704s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ee3a53-519f-4dd1-8f5c-0c17cd2d85e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198292e1-92a7-431f-a9ed-18c2eb637e90', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15279715-1895-4b79-92e7-91fb05962087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Creating offline snapshot b6c9d187-3c57-4efd-8a31-a1c1c200a13e of volume 2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:23:16 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Volume volume-198292e1-92a7-431f-a9ed-18c2eb637e90 (198292e1-92a7-431f-a9ed-18c2eb637e90): created successfully
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15279715-1895-4b79-92e7-91fb05962087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (f19bd277-4f8b-475d-b54e-a4a3aada3d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a4e9b6-cd33-4e9b-beb6-2a0c4a30aebd]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:16 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-383f4efc-0945-4d4f-8c84-d984cb67a281 tempest-VolumesGetTest-1171497064 None] Created volume successfully.
Apr 15 23:23:16 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3
Apr 15 23:23:16 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:17 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3" returned: 0 in 0.565s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:17 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e 1G
Apr 15 23:23:17 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (66d2c726-754f-4a9e-a64e-4ea6c3c8c328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd68b7b4-da11-4e8a-88b9-20de50f983a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd68b7b4-da11-4e8a-88b9-20de50f983a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1382331371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40d1a3a-ce86-432f-9ade-a02df5849875,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=198292e1-92a7-431f-a9ed-18c2eb637e90,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:17Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978c934c-ca89-4e2c-90be-5cbb4d175ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978c934c-ca89-4e2c-90be-5cbb4d175ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be633c92-c011-4375-b853-77b5f0cdaf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be633c92-c011-4375-b853-77b5f0cdaf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e40d1a3a-ce86-432f-9ade-a02df5849875', 'volume_name': 'volume-e40d1a3a-ce86-432f-9ade-a02df5849875', 'volume_size': 1, 'source_volid': '198292e1-92a7-431f-a9ed-18c2eb637e90', 'source_volstatus': 'available'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5332c5f3-57bb-4b65-88ea-547126039c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5332c5f3-57bb-4b65-88ea-547126039c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29861a5-f9ca-47df-b9d8-da6f122c1b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Volume e40d1a3a-ce86-432f-9ade-a02df5849875: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e40d1a3a-ce86-432f-9ade-a02df5849875', 'volume_size': 1, 'source_volid': '198292e1-92a7-431f-a9ed-18c2eb637e90', 'source_volstatus': 'available'}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:17 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e 1G" returned: 0 in 0.496s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:17 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e
Apr 15 23:23:17 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5e5216a4-c7a6-4b7c-b7a5-6b9a195a3e9a tempest-GroupsTest-66661954 None] Group tempest-Group1-1244971242: creating
Apr 15 23:23:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5e5216a4-c7a6-4b7c-b7a5-6b9a195a3e9a tempest-GroupsTest-66661954 None] Group tempest-Group1-1244971242: created successfully
Apr 15 23:23:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5e5216a4-c7a6-4b7c-b7a5-6b9a195a3e9a tempest-GroupsTest-66661954 None] Create group completed successfully.
Apr 15 23:23:18 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e" returned: 0 in 0.420s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:18 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e is being set with open permissions: ugo+rw
Apr 15 23:23:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:18 devstack sudo[87932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e
Apr 15 23:23:18 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:18 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e" returned: 0 in 0.384s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.169s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:18 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Cloning volume 198292e1-92a7-431f-a9ed-18c2eb637e90 to volume e40d1a3a-ce86-432f-9ade-a02df5849875
Apr 15 23:23:18 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f98e1a2d-b5e1-4a47-8d35-328931e7ec97 tempest-VolumesSnapshotListTestJSON-1289014534 None] Create snapshot completed successfully
Apr 15 23:23:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Creating offline snapshot b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 of volume 198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:23:18 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e806c25a-9edc-43d6-a508-f9441ed95f9d]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:18 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90
Apr 15 23:23:18 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:19 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c76e5176-3e31-4ad3-ba2d-cbe9f4897fa8 tempest-GroupsTest-66661954 None] Group tempest-Group2-130367476: creating
Apr 15 23:23:19 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c76e5176-3e31-4ad3-ba2d-cbe9f4897fa8 tempest-GroupsTest-66661954 None] Group tempest-Group2-130367476: created successfully
Apr 15 23:23:19 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c76e5176-3e31-4ad3-ba2d-cbe9f4897fa8 tempest-GroupsTest-66661954 None] Create group completed successfully.
Apr 15 23:23:19 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90" returned: 0 in 0.512s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:19 devstack sudo[87940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 1G
Apr 15 23:23:19 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:19 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 1G" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198292e1-92a7-431f-a9ed-18c2eb637e90 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:19 devstack sudo[87945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198292e1-92a7-431f-a9ed-18c2eb637e90 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678
Apr 15 23:23:19 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:19 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198292e1-92a7-431f-a9ed-18c2eb637e90 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" returned: 0 in 0.424s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:19 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 is being set with open permissions: ugo+rw
Apr 15 23:23:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:19 devstack sudo[87950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678
Apr 15 23:23:19 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Flow 'volume_create_manager' (c1894802-1391-4e9a-98c4-a1aa4d3293e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6045d9f-97a9-4873-ac9b-baaceabdc746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6045d9f-97a9-4873-ac9b-baaceabdc746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1144347369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5629de03-427c-4760-8594-6307d3e1dc8b,host='devstack@QuobyteHD#QuobyteHD',id=76be6af1-8c0c-4f4e-b0da-39f323006a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fecf63b3554fe88615ebbbf6fad0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:20Z,use_quota=True,user_id='012d41d71b774ce182fcba023b16c796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b449fef-e0de-4083-9f5f-22f2a71fb168),volume_type_id=2b449fef-e0de-4083-9f5f-22f2a71fb168)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999119ee-2d08-43ba-9deb-955686438ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999119ee-2d08-43ba-9deb-955686438ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562de82b-cb96-4281-b025-07baae7b22b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562de82b-cb96-4281-b025-07baae7b22b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76be6af1-8c0c-4f4e-b0da-39f323006a41', 'volume_name': 'volume-76be6af1-8c0c-4f4e-b0da-39f323006a41', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a92b19-2d66-4fbf-95af-17218e2c36a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a92b19-2d66-4fbf-95af-17218e2c36a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:20 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b554b0ff-09c6-4217-87c6-b644e3fc8540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:20 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Volume 76be6af1-8c0c-4f4e-b0da-39f323006a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76be6af1-8c0c-4f4e-b0da-39f323006a41', 'volume_size': 1}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" returned: 0 in 0.465s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:20 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.info
Apr 15 23:23:20 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:20 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.info" returned: 0 in 0.390s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:20 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.info is being set with open permissions: ugo+rw
Apr 15 23:23:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:20 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.info
Apr 15 23:23:20 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:21 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.info" returned: 0 in 0.457s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-e40d1a3a-ce86-432f-9ade-a02df5849875" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-e40d1a3a-ce86-432f-9ade-a02df5849875" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] snapshot: b6b4e5f4-00cb-40a9-a1f2-abfd2499b678, volume: e40d1a3a-ce86-432f-9ade-a02df5849875,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7855bbd-c303-4541-b3b3-b8647d55fd04]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:21 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678
Apr 15 23:23:21 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:21 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" returned: 0 in 0.467s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198292e1-92a7-431f-a9ed-18c2eb637e90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1e6a5d-52d6-46fd-b8e7-5dc2dddf016b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:21 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90
Apr 15 23:23:21 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:22 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90" returned: 0 in 0.449s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:22 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:23:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:22 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875
Apr 15 23:23:22 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:24 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875" returned: 0 in 1.979s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:24 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd0053e-d113-4aed-82b4-e40dbbf8fafa]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:24 devstack sudo[87981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90
Apr 15 23:23:24 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:24 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90" returned: 0 in 0.621s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:24 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:23:24 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Converted 1024.00 MB image at 517.22 MB/s
Apr 15 23:23:24 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875 is being set with open permissions: ugo+rw
Apr 15 23:23:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:24 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875
Apr 15 23:23:24 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:25 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875" returned: 0 in 0.443s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-e40d1a3a-ce86-432f-9ade-a02df5849875" released by "_copy_volume_from_snapshot" :: held 4.005s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Deleting offline snapshot b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 of volume 198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] snapshot_file for this snap is: volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1ebd72-8dee-4241-b8a4-9ff7605a17ee]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:25 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678
Apr 15 23:23:25 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:25 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" returned: 0 in 0.454s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198292e1-92a7-431f-a9ed-18c2eb637e90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dce3078-7dc5-462e-82eb-494fb47f37eb]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:25 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90
Apr 15 23:23:25 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:26 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90" returned: 0 in 0.451s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:26 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678
Apr 15 23:23:26 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:26 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" returned: 0 in 0.423s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:26 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678
Apr 15 23:23:26 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:27 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90.b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" returned: 0 in 0.397s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-b6b4e5f4-00cb-40a9-a1f2-abfd2499b678" released by "_delete_snapshot" :: held 1.768s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=111,cinder:INSERT=35,cinder:UPDATE=154,cinder:DELETE=9 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.616s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Creating offline snapshot e1458700-dbbe-49bf-a75d-229047d69363 of volume 2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29861a5-f9ca-47df-b9d8-da6f122c1b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40d1a3a-ce86-432f-9ade-a02df5849875', 'volume_size': 1, 'source_volid': '198292e1-92a7-431f-a9ed-18c2eb637e90', 'source_volstatus': 'available'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285dba33-6f88-4a41-9e3c-3235e3cb167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[b533bbad-30b6-4d12-b562-36d8b9e6423e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:27 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Volume volume-e40d1a3a-ce86-432f-9ade-a02df5849875 (e40d1a3a-ce86-432f-9ade-a02df5849875): created successfully
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285dba33-6f88-4a41-9e3c-3235e3cb167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (66d2c726-754f-4a9e-a64e-4ea6c3c8c328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:27 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-89cc75a9-9189-4f81-9391-6a462d11049b tempest-VolumesGetTest-1171497064 None] Created volume successfully.
Apr 15 23:23:27 devstack sudo[88008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e
Apr 15 23:23:27 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:27 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e" returned: 0 in 0.451s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:27 devstack sudo[88013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 1G
Apr 15 23:23:27 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:28 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 1G" returned: 0 in 0.528s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:28 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363
Apr 15 23:23:28 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (bd86cc52-d997-49c4-b3af-026dd2658b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e6b985-f5c8-48ea-aae6-660e98c60fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e6b985-f5c8-48ea-aae6-660e98c60fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1482782830',display_name='tempest-VolumesGetTest-Volume-686901356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f6d180-427a-4861-8882-fec72ac65cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:28Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de972cd-1ec3-444f-be4e-7dc5f9982ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de972cd-1ec3-444f-be4e-7dc5f9982ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e992bb2c-b8b4-49ca-be14-e3ca22bc8bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e992bb2c-b8b4-49ca-be14-e3ca22bc8bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f6d180-427a-4861-8882-fec72ac65cf9', 'volume_name': 'volume-03f6d180-427a-4861-8882-fec72ac65cf9', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e7ae6c-b405-444d-9582-c5710a50039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e7ae6c-b405-444d-9582-c5710a50039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cdd319-94e5-4760-9f5b-da2b3e1c7fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:28 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Volume 03f6d180-427a-4861-8882-fec72ac65cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f6d180-427a-4861-8882-fec72ac65cf9', 'volume_size': 1}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:28 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:28 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 is being set with open permissions: ugo+rw
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:28 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363
Apr 15 23:23:28 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:28 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363" returned: 0 in 0.383s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.540s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5629de03-427c-4760-8594-6307d3e1dc8b,created_at=2026-04-15T21:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1144347369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5629de03-427c-4760-8594-6307d3e1dc8b,host='devstack@QuobyteHD#QuobyteHD',id=76be6af1-8c0c-4f4e-b0da-39f323006a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fecf63b3554fe88615ebbbf6fad0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:20Z,use_quota=True,user_id='012d41d71b774ce182fcba023b16c796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b449fef-e0de-4083-9f5f-22f2a71fb168),volume_type_id=2b449fef-e0de-4083-9f5f-22f2a71fb168)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Creating volume 76be6af1-8c0c-4f4e-b0da-39f323006a41 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:28 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:28 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41 1073741824
Apr 15 23:23:28 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f074db9e-29fe-408b-b000-2f662c18f64a tempest-VolumesSnapshotListTestJSON-1289014534 None] Create snapshot completed successfully
Apr 15 23:23:29 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41 1073741824" returned: 0 in 0.473s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:29 devstack sudo[88031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41
Apr 15 23:23:29 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:29 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41" returned: 0 in 0.460s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1482782830',display_name='tempest-VolumesGetTest-Volume-686901356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f6d180-427a-4861-8882-fec72ac65cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:28Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Creating volume 03f6d180-427a-4861-8882-fec72ac65cf9 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:29 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b554b0ff-09c6-4217-87c6-b644e3fc8540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76be6af1-8c0c-4f4e-b0da-39f323006a41', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde3af28-56f8-47b9-b4c3-ec81ea81c95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:29 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9 1073741824
Apr 15 23:23:29 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:29 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Volume volume-76be6af1-8c0c-4f4e-b0da-39f323006a41 (76be6af1-8c0c-4f4e-b0da-39f323006a41): created successfully
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde3af28-56f8-47b9-b4c3-ec81ea81c95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Flow 'volume_create_manager' (c1894802-1391-4e9a-98c4-a1aa4d3293e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:29 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c4bc2ab6-395b-4049-9180-c8651517a8b0 tempest-GroupsTest-66661954 None] Created volume successfully.
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-e1458700-dbbe-49bf-a75d-229047d69363-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-e1458700-dbbe-49bf-a75d-229047d69363-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-quobyte-e1458700-dbbe-49bf-a75d-229047d69363" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-e1458700-dbbe-49bf-a75d-229047d69363" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Deleting offline snapshot e1458700-dbbe-49bf-a75d-229047d69363 of volume 2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] snapshot_file for this snap is: volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eeb062-d71e-4d27-a169-d80bc5565ff3]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:30 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363
Apr 15 23:23:30 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Acquiring lock "cinder-quobyte-76be6af1-8c0c-4f4e-b0da-39f323006a41" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Lock "cinder-quobyte-76be6af1-8c0c-4f4e-b0da-39f323006a41" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddecfea9-5f37-47c8-af11-9a8f4ef0ab1f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:30 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9 1073741824" returned: 0 in 0.578s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:30 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41
Apr 15 23:23:30 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:30 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9
Apr 15 23:23:30 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:30 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363" returned: 0 in 0.549s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca9299c-684a-4b32-91dd-c8bcf544ec6a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:30 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e
Apr 15 23:23:30 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:30 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:30 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41" returned: 0 in 0.479s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9" returned: 0 in 0.426s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:30 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41
Apr 15 23:23:30 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cdd319-94e5-4760-9f5b-da2b3e1c7fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f6d180-427a-4861-8882-fec72ac65cf9', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5012e9-17a1-46f0-b68a-f09712da25b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:30 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Volume volume-03f6d180-427a-4861-8882-fec72ac65cf9 (03f6d180-427a-4861-8882-fec72ac65cf9): created successfully
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5012e9-17a1-46f0-b68a-f09712da25b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:30 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (bd86cc52-d997-49c4-b3af-026dd2658b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:30 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ca1e3089-8d96-4e6b-8e04-dd909e3810d9 tempest-VolumesGetTest-1171497064 None] Created volume successfully.
Apr 15 23:23:31 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e" returned: 0 in 0.487s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:31 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363
Apr 15 23:23:31 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:31 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-76be6af1-8c0c-4f4e-b0da-39f323006a41" returned: 0 in 0.405s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Lock "cinder-quobyte-76be6af1-8c0c-4f4e-b0da-39f323006a41" released by "delete_volume" :: held 0.905s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Created reservations ['b7c1d4e5-1a96-4e7a-8165-e2dd146a7abc'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:31 devstack cinder-volume[81941]: WARNING cinder.quota [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1031912957 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1031912957, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:23:31 devstack cinder-volume[81941]: WARNING cinder.quota [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1031912957 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1031912957, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Created reservations ['cc6b683c-1d5e-4f0c-816e-c713689638d3', '35954d90-0efc-4af3-b940-7a7cccaa73ca', '47c75412-dfe7-4385-be17-86037c08f267', 'bc26722b-1521-4645-bdf5-9f0c8ca2cd62'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-03f6d180-427a-4861-8882-fec72ac65cf9-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Lock "cinder-03f6d180-427a-4861-8882-fec72ac65cf9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-03f6d180-427a-4861-8882-fec72ac65cf9" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-03f6d180-427a-4861-8882-fec72ac65cf9" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af6ab65-4d96-4e89-8d9b-66dc6b0e6de6]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:31 devstack sudo[88066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:31 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:31 devstack sudo[88065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9
Apr 15 23:23:31 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:31 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363" returned: 0 in 0.562s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:31 devstack sudo[88069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363
Apr 15 23:23:31 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:32 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:32 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b7692486-8a31-4bfa-b98e-a9efb04178da tempest-GroupsTest-66661954 None] Delete group completed successfully.
Apr 15 23:23:32 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9" returned: 0 in 0.482s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:32 devstack sudo[88076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9
Apr 15 23:23:32 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:32 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.e1458700-dbbe-49bf-a75d-229047d69363" returned: 0 in 0.423s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-e1458700-dbbe-49bf-a75d-229047d69363" released by "_delete_snapshot" :: held 2.064s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" released by "delete_snapshot" :: held 2.076s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Created reservations ['5f74606c-5576-492d-8f2c-4f64b58e1451', 'b32445bf-535c-4d2b-b48a-28f9191dc2fd', '975502d3-3b8c-4ee9-b7a3-3fc4341d874f', '23de588b-7331-48e7-96d3-f9165395aef5'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:32 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Delete snapshot completed successfully.
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c1688510-46ad-4ab7-b68a-5d26910a9a01 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-e1458700-dbbe-49bf-a75d-229047d69363-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:32 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-03f6d180-427a-4861-8882-fec72ac65cf9" returned: 0 in 0.432s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-03f6d180-427a-4861-8882-fec72ac65cf9" released by "delete_volume" :: held 0.945s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Created reservations ['789fbe5b-c378-4537-8b95-8120c69252a3', '90da4018-90ab-419b-8486-c7ba05106ea2', 'b008a262-1f0f-43c1-9ca0-9de2f494d7e0', 'd92b95f7-8f52-4668-9d30-e91d64266ac8'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:32 devstack sudo[88085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:32 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-e40d1a3a-ce86-432f-9ade-a02df5849875-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Lock "cinder-e40d1a3a-ce86-432f-9ade-a02df5849875-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-e40d1a3a-ce86-432f-9ade-a02df5849875" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Created reservations ['ef1c88e2-e961-4802-a283-389a9a15b097'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-e40d1a3a-ce86-432f-9ade-a02df5849875" acquired by "delete_volume" :: waited 0.018s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[9021ca98-ceb8-4fca-80a4-ea43df9a97c8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:32 devstack sudo[88088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:32 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:32 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875
Apr 15 23:23:32 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:32 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.441s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:32 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Deleted volume successfully.
Apr 15 23:23:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c60f994c-68c9-4769-8384-d8127e754bb8 tempest-VolumesGetTest-1171497064 None] Lock "cinder-03f6d180-427a-4861-8882-fec72ac65cf9-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-b6c9d187-3c57-4efd-8a31-a1c1c200a13e-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-b6c9d187-3c57-4efd-8a31-a1c1c200a13e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-quobyte-b6c9d187-3c57-4efd-8a31-a1c1c200a13e" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-b6c9d187-3c57-4efd-8a31-a1c1c200a13e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Deleting offline snapshot b6c9d187-3c57-4efd-8a31-a1c1c200a13e of volume 2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] snapshot_file for this snap is: volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:23:33 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.410s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b54d2-2938-4de3-a52b-9a469a88a691]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:33 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4541daa7-9e7c-49d3-b23e-c74b2ba8c660 tempest-GroupsTest-66661954 None] Delete group completed successfully.
Apr 15 23:23:33 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875" returned: 0 in 0.501s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:33 devstack sudo[88096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e
Apr 15 23:23:33 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:33 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875
Apr 15 23:23:33 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:33 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e" returned: 0 in 0.455s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aea1cb2-5c5a-4e54-a486-b1888bd30173]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:33 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e40d1a3a-ce86-432f-9ade-a02df5849875" returned: 0 in 0.434s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-e40d1a3a-ce86-432f-9ade-a02df5849875" released by "delete_volume" :: held 0.965s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:33 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3
Apr 15 23:23:33 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Created reservations ['dbeea488-9bad-42fa-9ebe-6a64dbdbb4d2', '1ecdbee0-d957-4d67-a8fc-6840bc5bf51a', 'a68e227b-07dc-4b19-9021-b389072ab813', 'b0d11290-0e5d-47aa-a6d1-e9f995a005e5'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:33 devstack sudo[88106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:33 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-badc5e89-9485-499b-ba3c-0ffa7e19d088 tempest-GroupsTest-66661954 None] Group tempest-GroupsTest-Group-60829400: creating
Apr 15 23:23:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-badc5e89-9485-499b-ba3c-0ffa7e19d088 tempest-GroupsTest-66661954 None] Group tempest-GroupsTest-Group-60829400: created successfully
Apr 15 23:23:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-badc5e89-9485-499b-ba3c-0ffa7e19d088 tempest-GroupsTest-66661954 None] Create group completed successfully.
Apr 15 23:23:34 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3" returned: 0 in 0.514s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:34 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e
Apr 15 23:23:34 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:34 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.471s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Deleted volume successfully.
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-206511ef-1b24-4b5a-8da3-af30360c3479 tempest-VolumesGetTest-1171497064 None] Lock "cinder-e40d1a3a-ce86-432f-9ade-a02df5849875-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:34 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:34 devstack sudo[88117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e
Apr 15 23:23:34 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-198292e1-92a7-431f-a9ed-18c2eb637e90-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Lock "cinder-198292e1-92a7-431f-a9ed-18c2eb637e90-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-198292e1-92a7-431f-a9ed-18c2eb637e90" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-198292e1-92a7-431f-a9ed-18c2eb637e90" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df11f25-4a10-45ed-b4ce-bf353c65ea71]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:35 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90
Apr 15 23:23:35 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:35 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.b6c9d187-3c57-4efd-8a31-a1c1c200a13e" returned: 0 in 0.444s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-b6c9d187-3c57-4efd-8a31-a1c1c200a13e" released by "_delete_snapshot" :: held 1.923s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" released by "delete_snapshot" :: held 1.936s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Created reservations ['a2d2620b-01a6-4afe-b3a3-5bd7a3c681c3', 'e7dc351e-b384-44c9-8d63-71b2fced7878', '30b53311-7375-4ad5-ae1e-312cb6bf113a', '5ee68b7c-d40c-4b5a-8025-25b106cd8a5c'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Delete snapshot completed successfully.
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c884895b-a6ba-4937-9765-6f4a5c021f0e tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-b6c9d187-3c57-4efd-8a31-a1c1c200a13e-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-553d5e36-69d9-4b42-a4f4-e1c87684f6d3-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-553d5e36-69d9-4b42-a4f4-e1c87684f6d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-quobyte-553d5e36-69d9-4b42-a4f4-e1c87684f6d3" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-553d5e36-69d9-4b42-a4f4-e1c87684f6d3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Deleting offline snapshot 553d5e36-69d9-4b42-a4f4-e1c87684f6d3 of volume 2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] snapshot_file for this snap is: volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[718ade99-1481-427a-a124-908f048e0c7b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:35 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3
Apr 15 23:23:35 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Flow 'volume_create_manager' (58410d50-5474-4776-a212-84fe7f4ea97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de20453c-6fac-4563-bc81-edbe2f8c4322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de20453c-6fac-4563-bc81-edbe2f8c4322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-926909554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=33fde86a-5453-419d-acb0-5ee01c7e6918,host='devstack@QuobyteHD#QuobyteHD',id=db388871-76e9-4b72-910e-8a0eae05632b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fecf63b3554fe88615ebbbf6fad0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:35Z,use_quota=True,user_id='012d41d71b774ce182fcba023b16c796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1988aba3-e63f-4ebe-8980-a87f959ffb56),volume_type_id=1988aba3-e63f-4ebe-8980-a87f959ffb56)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f1c733-9fe5-483b-bd74-e8430ab50ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f1c733-9fe5-483b-bd74-e8430ab50ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0bcc63-b30e-4a5b-86ad-043ee15b1208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0bcc63-b30e-4a5b-86ad-043ee15b1208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db388871-76e9-4b72-910e-8a0eae05632b', 'volume_name': 'volume-db388871-76e9-4b72-910e-8a0eae05632b', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979e0805-c92f-40e2-94c9-a42a05fb4e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979e0805-c92f-40e2-94c9-a42a05fb4e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f818db-92c1-49f7-a0bb-3fb523f83a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:35 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Volume db388871-76e9-4b72-910e-8a0eae05632b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db388871-76e9-4b72-910e-8a0eae05632b', 'volume_size': 1}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=33fde86a-5453-419d-acb0-5ee01c7e6918,created_at=2026-04-15T21:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-926909554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=33fde86a-5453-419d-acb0-5ee01c7e6918,host='devstack@QuobyteHD#QuobyteHD',id=db388871-76e9-4b72-910e-8a0eae05632b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fecf63b3554fe88615ebbbf6fad0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:35Z,use_quota=True,user_id='012d41d71b774ce182fcba023b16c796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1988aba3-e63f-4ebe-8980-a87f959ffb56),volume_type_id=1988aba3-e63f-4ebe-8980-a87f959ffb56)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Creating volume db388871-76e9-4b72-910e-8a0eae05632b {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:35 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:35 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90" returned: 0 in 0.531s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:35 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b 1073741824
Apr 15 23:23:35 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:35 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90
Apr 15 23:23:35 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:35 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3" returned: 0 in 0.534s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fc98e-c54a-4dcb-a481-df41fe9978fb]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:35 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-198292e1-92a7-431f-a9ed-18c2eb637e90" returned: 0 in 0.422s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:35 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97
Apr 15 23:23:35 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-198292e1-92a7-431f-a9ed-18c2eb637e90" released by "delete_volume" :: held 0.986s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:35 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b 1073741824" returned: 0 in 0.489s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:35 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Created reservations ['514ee6d5-2e8d-42f5-962f-874b2d5dce89', '8a71008a-d5bc-4d04-95df-83bc95671a1f', 'c5166b8b-5c94-4307-9743-ec3d2357b490', 'afef248e-2dde-4e7b-bda7-1b76daca8610'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:36 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b
Apr 15 23:23:36 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:36 devstack sudo[88143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:36 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:36 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" returned: 0 in 0.499s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:36 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3
Apr 15 23:23:36 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:36 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b" returned: 0 in 0.426s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:DELETE=23,cinder:SELECT=160,cinder:UPDATE=204,cinder:INSERT=47 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f818db-92c1-49f7-a0bb-3fb523f83a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db388871-76e9-4b72-910e-8a0eae05632b', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf2503a-319a-4c65-a203-18d176a8bfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:36 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Volume volume-db388871-76e9-4b72-910e-8a0eae05632b (db388871-76e9-4b72-910e-8a0eae05632b): created successfully
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf2503a-319a-4c65-a203-18d176a8bfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Flow 'volume_create_manager' (58410d50-5474-4776-a212-84fe7f4ea97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:36 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.423s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Deleted volume successfully.
Apr 15 23:23:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-afe3d46f-7a17-418f-b9c1-b6fc21c9c6f8 tempest-GroupsTest-66661954 None] Created volume successfully.
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e893264b-ed08-4373-bcbb-db3067d1c685 tempest-VolumesGetTest-1171497064 None] Lock "cinder-198292e1-92a7-431f-a9ed-18c2eb637e90-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:36 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3" returned: 0 in 0.465s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:36 devstack sudo[88155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3
Apr 15 23:23:36 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:37 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97.553d5e36-69d9-4b42-a4f4-e1c87684f6d3" returned: 0 in 0.438s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-553d5e36-69d9-4b42-a4f4-e1c87684f6d3" released by "_delete_snapshot" :: held 1.988s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" released by "delete_snapshot" :: held 2.004s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Created reservations ['053e22c6-9864-4bd7-90dd-6289ea48b3ba', 'a0e380cf-e553-4e81-9691-cc68fc4dea01', '7f02d578-2d70-43d4-967a-8d9b87dfad72', '3046dc3e-89a1-4f42-86c6-83936ba3ec0e'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:37 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Delete snapshot completed successfully.
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-513378f4-704d-4573-9896-8281a6f8d003 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-553d5e36-69d9-4b42-a4f4-e1c87684f6d3-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (215da0d0-f682-447b-8d5e-8b87f4608b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf84fa0-8e30-42ec-9597-90e3119c5f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf84fa0-8e30-42ec-9597-90e3119c5f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-181035569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367d57ee-dd18-4470-a6d1-c6b3c23033d8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:37Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eb97ac-7727-4d68-b716-36c36c77fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eb97ac-7727-4d68-b716-36c36c77fa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915f6721-57a6-4885-ba28-032d0bfb8236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.image.glance [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Creating Keystone auth plugin from conf {{(pid=81941) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915f6721-57a6-4885-ba28-032d0bfb8236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '367d57ee-dd18-4470-a6d1-c6b3c23033d8', 'volume_name': 'volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1155fa9f60>}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489acd05-564c-474c-bf66-7f08181420b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489acd05-564c-474c-bf66-7f08181420b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d204f22b-1333-4bfe-a8e8-d6d7aba7bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Volume 367d57ee-dd18-4470-a6d1-c6b3c23033d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1155fa9f60>}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Trying to clone 367d57ee-dd18-4470-a6d1-c6b3c23033d8 from image 0e2861bb-d33e-45a3-86bc-d3d94070676e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]). {{(pid=81941) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Flow 'volume_create_manager' (61be9345-244c-4ed6-987c-0be6f4d9685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872ae07a-6f1c-44cb-95fb-ec20f428ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872ae07a-6f1c-44cb-95fb-ec20f428ef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-294504610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=33fde86a-5453-419d-acb0-5ee01c7e6918,host='devstack@QuobyteHD#QuobyteHD',id=7f4b3d0a-ac9e-4d48-bd42-992ca73b2942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fecf63b3554fe88615ebbbf6fad0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:38Z,use_quota=True,user_id='012d41d71b774ce182fcba023b16c796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1988aba3-e63f-4ebe-8980-a87f959ffb56),volume_type_id=1988aba3-e63f-4ebe-8980-a87f959ffb56)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799cfa85-87ad-4651-a179-660d3af73e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799cfa85-87ad-4651-a179-660d3af73e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77290e5-43b4-42cf-bbdf-4ea801ac94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77290e5-43b4-42cf-bbdf-4ea801ac94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4b3d0a-ac9e-4d48-bd42-992ca73b2942', 'volume_name': 'volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb71b6e1-c47d-4809-bb29-b031b3084057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb71b6e1-c47d-4809-bb29-b031b3084057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89c6eee-168f-4d44-886a-c1d77816aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:37 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Volume 7f4b3d0a-ac9e-4d48-bd42-992ca73b2942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942', 'volume_size': 1}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=33fde86a-5453-419d-acb0-5ee01c7e6918,created_at=2026-04-15T21:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-294504610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=33fde86a-5453-419d-acb0-5ee01c7e6918,host='devstack@QuobyteHD#QuobyteHD',id=7f4b3d0a-ac9e-4d48-bd42-992ca73b2942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fecf63b3554fe88615ebbbf6fad0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:38Z,use_quota=True,user_id='012d41d71b774ce182fcba023b16c796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1988aba3-e63f-4ebe-8980-a87f959ffb56),volume_type_id=1988aba3-e63f-4ebe-8980-a87f959ffb56)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Creating volume 7f4b3d0a-ac9e-4d48-bd42-992ca73b2942 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:37 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:37 devstack sudo[88158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942 1073741824
Apr 15 23:23:37 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 23:23:38 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba571cf3-30bd-4442-9049-efa8ae82ff5a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:38 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD
Apr 15 23:23:38 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-2bfaf15f-f177-4bb8-8618-5fd4a0597d97-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:38 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-2bfaf15f-f177-4bb8-8618-5fd4a0597d97-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942 1073741824" returned: 0 in 0.519s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:38 devstack sudo[88169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942
Apr 15 23:23:38 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" acquired by "delete_volume" :: waited 0.028s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[b074e286-33b9-4300-b715-f0ac242d1c6b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:38 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Temporary image 0e2861bb-d33e-45a3-86bc-d3d94070676e is fetched for user 3f51b78b873b441bbc04af65c726989e. {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 23:23:38 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0645e49-9cc8-4aa2-bcf9-ae13295b65f0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:38 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:38 devstack sudo[88173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD
Apr 15 23:23:38 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:38 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942" returned: 0 in 0.430s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89c6eee-168f-4d44-886a-c1d77816aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1991baf5-8d9e-465f-996b-5608bb8357ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:38 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Volume volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942 (7f4b3d0a-ac9e-4d48-bd42-992ca73b2942): created successfully
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1991baf5-8d9e-465f-996b-5608bb8357ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Flow 'volume_create_manager' (61be9345-244c-4ed6-987c-0be6f4d9685d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a6878cca-a48c-490b-82be-44fc4544d505 tempest-GroupsTest-66661954 None] Created volume successfully.
Apr 15 23:23:39 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" returned: 0 in 0.506s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:39 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97
Apr 15 23:23:39 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:39 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-181035569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367d57ee-dd18-4470-a6d1-c6b3c23033d8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:37Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Creating volume 367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:39 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:39 devstack sudo[88184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 1073741824
Apr 15 23:23:39 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:39 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" returned: 0 in 0.405s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-quobyte-2bfaf15f-f177-4bb8-8618-5fd4a0597d97" released by "delete_volume" :: held 0.937s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Created reservations ['98407324-6e29-4b2f-aae1-0704d83ac0e1', 'e586a186-d645-4088-8549-c298ee82b402', 'b1ccd0fe-f798-4d5f-a924-8c6cccf0e660', 'a9a56c80-0688-4a42-9c51-299c382fb93b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:39 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:39 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:39 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 1073741824" returned: 0 in 0.501s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:39 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8
Apr 15 23:23:39 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:40 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.461s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Deleted volume successfully.
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4d0e1d30-5714-4467-bdc1-d54c5fdca727 tempest-VolumesSnapshotListTestJSON-1289014534 None] Lock "cinder-2bfaf15f-f177-4bb8-8618-5fd4a0597d97-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:40 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8" returned: 0 in 0.494s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6e63c8a5-bb42-4114-972f-f1154649d106 tempest-GroupsTest-66661954 None] Update group completed successfully.
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Attempting download of 0e2861bb-d33e-45a3-86bc-d3d94070676e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}])) to volume 367d57ee-dd18-4470-a6d1-c6b3c23033d8. {{(pid=81941) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d2fe46-6996-4cf6-92fe-1b5159b2509a]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_fnv89xtf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:40 devstack sudo[88196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_fnv89xtf
Apr 15 23:23:40 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:40 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_fnv89xtf" returned: 0 in 0.545s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_fnv89xtf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:40 devstack sudo[88200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_fnv89xtf
Apr 15 23:23:40 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:41 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_fnv89xtf" returned: 1 in 0.540s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_fnv89xtf' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a2433f-4cb8-41f5-8e6b-ba8ea60f48fe]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8ceb9e29-7349-42b1-af95-3c12867772d8 tempest-GroupsTest-66661954 None] Update group completed successfully.
Apr 15 23:23:41 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD
Apr 15 23:23:41 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (fa7ba439-0ec0-4496-97c7-da67b2d86830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f6c10a-450c-4763-a8b3-79dcd765ece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f6c10a-450c-4763-a8b3-79dcd765ece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2038214811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cef2e0-655c-432a-abea-1d57561e0624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:41Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ffac16-ba2f-4749-a3a2-bf3541054ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ffac16-ba2f-4749-a3a2-bf3541054ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec6a543-7ed6-499e-b637-4e0d1aa40d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec6a543-7ed6-499e-b637-4e0d1aa40d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38cef2e0-655c-432a-abea-1d57561e0624', 'volume_name': 'volume-38cef2e0-655c-432a-abea-1d57561e0624', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cd723b-1ac0-4058-902f-92f791063e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cd723b-1ac0-4058-902f-92f791063e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f1bc2f-f499-4dff-b013-66c13cace082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume 38cef2e0-655c-432a-abea-1d57561e0624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38cef2e0-655c-432a-abea-1d57561e0624', 'volume_size': 1}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2038214811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cef2e0-655c-432a-abea-1d57561e0624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:41Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Creating volume 38cef2e0-655c-432a-abea-1d57561e0624 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:41 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:41 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624 1073741824
Apr 15 23:23:41 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:41 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] 0e2861bb-d33e-45a3-86bc-d3d94070676e was qcow2, converting to raw {{(pid=81941) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 23:23:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:41 devstack sudo[88212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8
Apr 15 23:23:41 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:42 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624 1073741824" returned: 0 in 0.501s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:42 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624
Apr 15 23:23:42 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:42 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624" returned: 0 in 0.515s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f1bc2f-f499-4dff-b013-66c13cace082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38cef2e0-655c-432a-abea-1d57561e0624', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713ba6fd-4244-4588-a635-ce16331d03ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:42 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume volume-38cef2e0-655c-432a-abea-1d57561e0624 (38cef2e0-655c-432a-abea-1d57561e0624): created successfully
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713ba6fd-4244-4588-a635-ce16331d03ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (fa7ba439-0ec0-4496-97c7-da67b2d86830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:42 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f675eaab-67ac-4969-8bc0-bb74ffe17dd3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created volume successfully.
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Acquiring lock "cinder-quobyte-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Lock "cinder-quobyte-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c1713b-5da7-48f3-9241-4c74ddeca91e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:42 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8" returned: 0 in 1.005s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_iw06el5wdevstack@QuobyteHD, size 112.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:23:42 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Converted 112.00 MB image at 111.36 MB/s
Apr 15 23:23:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:42 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 1G
Apr 15 23:23:42 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:42 devstack sudo[88259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942
Apr 15 23:23:42 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:43 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942" returned: 0 in 0.454s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:43 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 1G" returned: 0 in 0.426s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:43 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942
Apr 15 23:23:43 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50e4bb9-3e6b-4fb8-bc75-70f784d9cff5]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:43 devstack sudo[88271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8
Apr 15 23:23:43 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:43 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942" returned: 0 in 0.458s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Lock "cinder-quobyte-7f4b3d0a-ac9e-4d48-bd42-992ca73b2942" released by "delete_volume" :: held 0.939s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Acquiring lock "cinder-quobyte-db388871-76e9-4b72-910e-8a0eae05632b" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Lock "cinder-quobyte-db388871-76e9-4b72-910e-8a0eae05632b" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:43 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8" returned: 0 in 0.474s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7f207e-e9f6-4df1-9671-fa57c4334624]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (6ca87975-be4a-44c5-b0b6-2e2ce2c3732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20db9ea4-fdea-4631-84f9-ce6b9374ed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:43 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8
Apr 15 23:23:43 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:43 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20db9ea4-fdea-4631-84f9-ce6b9374ed36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297761010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb82bf95-7fbd-44a1-a4b1-a26677849d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:44Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:43 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cdfc4c-83f6-4cd0-b2ee-e1f9aab2612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cdfc4c-83f6-4cd0-b2ee-e1f9aab2612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10515c5b-0ac5-4142-8618-181bc045f486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10515c5b-0ac5-4142-8618-181bc045f486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb82bf95-7fbd-44a1-a4b1-a26677849d28', 'volume_name': 'volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe75cf9-25d0-4821-a1e5-487f6fe21d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe75cf9-25d0-4821-a1e5-487f6fe21d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0f80e2-d8dc-4430-a3fc-401ad57054b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:43 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume bb82bf95-7fbd-44a1-a4b1-a26677849d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28', 'volume_size': 1}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297761010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb82bf95-7fbd-44a1-a4b1-a26677849d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:44Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Creating volume bb82bf95-7fbd-44a1-a4b1-a26677849d28 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:43 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:43 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28 1073741824
Apr 15 23:23:43 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (9acc8694-098b-4c58-a8ff-eb6c03103bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819a16cd-da9a-416f-a71b-496137ddc137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819a16cd-da9a-416f-a71b-496137ddc137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359342274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5810af64-d5f4-4d31-b9ad-21548606a69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:44Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0b45ca-614a-4758-8266-afb8bab8fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0b45ca-614a-4758-8266-afb8bab8fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5581b89c-1a77-4ef6-ba54-2442ebf38014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5581b89c-1a77-4ef6-ba54-2442ebf38014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5810af64-d5f4-4d31-b9ad-21548606a69b', 'volume_name': 'volume-5810af64-d5f4-4d31-b9ad-21548606a69b', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f05c138-21da-4c08-b42e-b8f37dd1bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f05c138-21da-4c08-b42e-b8f37dd1bc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedb1c91-f48e-43e5-8817-32fd07e06389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume 5810af64-d5f4-4d31-b9ad-21548606a69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5810af64-d5f4-4d31-b9ad-21548606a69b', 'volume_size': 1}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (8feba83e-ffaf-4bd9-b5e4-8aa65344d339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082efc5f-59cc-44d5-9db4-7845de30f5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082efc5f-59cc-44d5-9db4-7845de30f5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138512228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c140a8-cb01-4004-b940-2a3280c870bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:44Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b89229d-ea1c-403c-8f61-35d8f7204ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b89229d-ea1c-403c-8f61-35d8f7204ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfa5bc2-b697-4d16-b833-e3ce8e5edd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfa5bc2-b697-4d16-b833-e3ce8e5edd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c140a8-cb01-4004-b940-2a3280c870bd', 'volume_name': 'volume-44c140a8-cb01-4004-b940-2a3280c870bd', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af0958c-019b-4e6c-88e6-2a9cfe5264fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af0958c-019b-4e6c-88e6-2a9cfe5264fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f6f942-5dff-4ad6-95b4-c3dd2d925046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume 44c140a8-cb01-4004-b940-2a3280c870bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c140a8-cb01-4004-b940-2a3280c870bd', 'volume_size': 1}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8" returned: 1 in 0.621s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Downloaded image 0e2861bb-d33e-45a3-86bc-d3d94070676e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}])) to volume 367d57ee-dd18-4470-a6d1-c6b3c23033d8 successfully. {{(pid=81941) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Temporary image 0e2861bb-d33e-45a3-86bc-d3d94070676e for user 3f51b78b873b441bbc04af65c726989e is deleted. {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Marking volume 367d57ee-dd18-4470-a6d1-c6b3c23033d8 as bootable. {{(pid=81941) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Copying metadata from image 0e2861bb-d33e-45a3-86bc-d3d94070676e to 367d57ee-dd18-4470-a6d1-c6b3c23033d8. {{(pid=81941) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Creating volume glance metadata for volume 367d57ee-dd18-4470-a6d1-c6b3c23033d8 backed by image 0e2861bb-d33e-45a3-86bc-d3d94070676e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81941) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 23:23:44 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b" returned: 0 in 0.690s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:44 devstack sudo[88291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b
Apr 15 23:23:44 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d204f22b-1333-4bfe-a8e8-d6d7aba7bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f1155fa9f60>}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba41aedd-b578-4f99-8b73-105af59de05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Volume volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 (367d57ee-dd18-4470-a6d1-c6b3c23033d8): created successfully
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba41aedd-b578-4f99-8b73-105af59de05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (215da0d0-f682-447b-8d5e-8b87f4608b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:44 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ab395096-6f5a-40f1-af7d-87a0730d88c8 tempest-VolumesGetTest-1171497064 None] Created volume successfully.
Apr 15 23:23:44 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28 1073741824" returned: 0 in 0.636s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:44 devstack sudo[88293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28
Apr 15 23:23:44 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (f258af22-89f9-4f7b-bead-9be85ab17d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ea5035-a2f4-4a44-9e23-73f568bf5b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ea5035-a2f4-4a44-9e23-73f568bf5b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548139615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ef1243-3d98-4b16-b372-e902a202fe14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:45Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3539cf25-db40-4058-9819-780c575cb73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3539cf25-db40-4058-9819-780c575cb73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0bacc5-3d2d-43db-a55a-aa9011850a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0bacc5-3d2d-43db-a55a-aa9011850a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ef1243-3d98-4b16-b372-e902a202fe14', 'volume_name': 'volume-d2ef1243-3d98-4b16-b372-e902a202fe14', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f81cf2-e1c7-4cd6-8d39-431f9e28ac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f81cf2-e1c7-4cd6-8d39-431f9e28ac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a34d41-6ac6-4f32-8300-0275d0797105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume d2ef1243-3d98-4b16-b372-e902a202fe14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ef1243-3d98-4b16-b372-e902a202fe14', 'volume_size': 1}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (fc3d22f1-a3c2-40fd-b86a-ea43798bc857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4da2a5-eb10-47a1-9b7b-7ad023ce5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4da2a5-eb10-47a1-9b7b-7ad023ce5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809264379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23e4888-011f-4705-ad5a-b4958ae60a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:45Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b4636f-75da-434a-abd5-e6f537298ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b4636f-75da-434a-abd5-e6f537298ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffaf100-7f5a-4b4d-b92e-6253c62ea79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffaf100-7f5a-4b4d-b92e-6253c62ea79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23e4888-011f-4705-ad5a-b4958ae60a3f', 'volume_name': 'volume-b23e4888-011f-4705-ad5a-b4958ae60a3f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d20e939-c67e-42e5-9b85-4007bacbdfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d20e939-c67e-42e5-9b85-4007bacbdfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8295c183-335a-45a4-8d42-74dcc99b20bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:44 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume b23e4888-011f-4705-ad5a-b4958ae60a3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23e4888-011f-4705-ad5a-b4958ae60a3f', 'volume_size': 1}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:44 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-db388871-76e9-4b72-910e-8a0eae05632b" returned: 0 in 0.501s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Lock "cinder-quobyte-db388871-76e9-4b72-910e-8a0eae05632b" released by "delete_volume" :: held 1.243s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:44 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Created reservations ['e8b586f0-707c-4187-a212-05b7f7ca6fe8'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:44 devstack cinder-volume[81941]: WARNING cinder.quota [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1317133851 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1317133851, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:23:44 devstack cinder-volume[81941]: WARNING cinder.quota [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1317133851 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1317133851, it is now deprecated. Please use the default quota class for default quota.
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Created reservations ['4486827e-7312-4a6b-9252-28586328470c', '53144f80-eb5a-4ec4-b866-70ceb81f109c', '4e6b71b3-c9b5-4b96-bf8b-3b035f485979', '3a883d9a-f772-4e3c-8e2f-f0c09353f44a'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Created reservations ['a0c91ca9-ed5a-4034-884a-934593bd6026', 'ca5d2b79-0bab-4312-b16e-ac5e937a3f5e', '2595de15-fa16-45ab-9a17-b0fcf81b6448', 'db34aeae-b9cf-431b-b821-e18b41a7e2fb'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:45 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28" returned: 0 in 0.587s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359342274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5810af64-d5f4-4d31-b9ad-21548606a69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:44Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Creating volume 5810af64-d5f4-4d31-b9ad-21548606a69b {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:45 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0f80e2-d8dc-4430-a3fc-401ad57054b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef09a7ad-1ad9-4c9f-a47c-5e9ef7783e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:45 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b 1073741824
Apr 15 23:23:45 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:45 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28 (bb82bf95-7fbd-44a1-a4b1-a26677849d28): created successfully
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef09a7ad-1ad9-4c9f-a47c-5e9ef7783e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (6ca87975-be4a-44c5-b0b6-2e2ce2c3732e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:45 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:45 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:45 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-fcb85cda-67bf-4af4-9cbe-533c83d3727d tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created volume successfully.
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (7e5b8e39-7adb-41a5-a563-b70775345e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e798fb0c-8e17-4b65-9298-602d2ab19388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e798fb0c-8e17-4b65-9298-602d2ab19388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-512279039',display_name='tempest-VolumesGetTest-Volume-1674785198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed670fca-d2ea-4760-b216-9b20b1fc9d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:45Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2648f4-113f-48b5-bd29-9232e302c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2648f4-113f-48b5-bd29-9232e302c70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bef30e-42b3-4a26-93fc-9ebddd4f5ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bef30e-42b3-4a26-93fc-9ebddd4f5ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed670fca-d2ea-4760-b216-9b20b1fc9d1a', 'volume_name': 'volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ab178d-8214-4cab-a4d6-721d14c1035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ab178d-8214-4cab-a4d6-721d14c1035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2762f51-cbef-429f-a0af-8ac55e64a3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:45 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Volume ed670fca-d2ea-4760-b216-9b20b1fc9d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a', 'volume_size': 1}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:45 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b 1073741824" returned: 0 in 0.507s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:45 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.442s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:45 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-df26803c-73b5-4f74-8ae9-0534f48aefcf tempest-GroupsTest-66661954 None] Delete group completed successfully.
Apr 15 23:23:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:45 devstack sudo[88306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b
Apr 15 23:23:45 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:46 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b" returned: 0 in 0.407s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138512228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c140a8-cb01-4004-b940-2a3280c870bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:44Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Creating volume 44c140a8-cb01-4004-b940-2a3280c870bd {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:46 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedb1c91-f48e-43e5-8817-32fd07e06389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5810af64-d5f4-4d31-b9ad-21548606a69b', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:46 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd 1073741824
Apr 15 23:23:46 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dacc67-9215-42c6-adff-c44b432c5d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:46 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume volume-5810af64-d5f4-4d31-b9ad-21548606a69b (5810af64-d5f4-4d31-b9ad-21548606a69b): created successfully
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dacc67-9215-42c6-adff-c44b432c5d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (9acc8694-098b-4c58-a8ff-eb6c03103bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:46 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-78feeea5-a216-4f34-b73c-10d43d4824a3 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created volume successfully.
Apr 15 23:23:46 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd 1073741824" returned: 0 in 0.548s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:46 devstack sudo[88314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd
Apr 15 23:23:46 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:47 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd" returned: 0 in 0.428s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.401s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548139615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ef1243-3d98-4b16-b372-e902a202fe14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:45Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Creating volume d2ef1243-3d98-4b16-b372-e902a202fe14 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:47 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f6f942-5dff-4ad6-95b4-c3dd2d925046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c140a8-cb01-4004-b940-2a3280c870bd', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:47 devstack sudo[88317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14 1073741824
Apr 15 23:23:47 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e458c31-5543-4b75-aefb-864b168c245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:47 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume volume-44c140a8-cb01-4004-b940-2a3280c870bd (44c140a8-cb01-4004-b940-2a3280c870bd): created successfully
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e458c31-5543-4b75-aefb-864b168c245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (8feba83e-ffaf-4bd9-b5e4-8aa65344d339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:47 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-59f29280-5332-47bd-a445-2abf63442f91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created volume successfully.
Apr 15 23:23:47 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14 1073741824" returned: 0 in 0.570s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:47 devstack sudo[88322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14
Apr 15 23:23:47 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:48 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.284s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809264379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23e4888-011f-4705-ad5a-b4958ae60a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff41b10c59945f482b810c27fea9e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:45Z,use_quota=True,user_id='ee474c75f0d044d1bae65812c1ab6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Creating volume b23e4888-011f-4705-ad5a-b4958ae60a3f {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:48 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a34d41-6ac6-4f32-8300-0275d0797105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ef1243-3d98-4b16-b372-e902a202fe14', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:48 devstack sudo[88325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f 1073741824
Apr 15 23:23:48 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693189d0-825a-4a66-82ee-8b282cbf2951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:48 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume volume-d2ef1243-3d98-4b16-b372-e902a202fe14 (d2ef1243-3d98-4b16-b372-e902a202fe14): created successfully
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693189d0-825a-4a66-82ee-8b282cbf2951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (f258af22-89f9-4f7b-bead-9be85ab17d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:48 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-22f46d17-582d-4522-85d5-2fab25492eb7 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created volume successfully.
Apr 15 23:23:48 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f 1073741824" returned: 0 in 0.507s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:48 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f
Apr 15 23:23:48 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:49 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f" returned: 0 in 0.492s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.842s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-512279039',display_name='tempest-VolumesGetTest-Volume-1674785198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed670fca-d2ea-4760-b216-9b20b1fc9d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3319459e8e704d2da7f89127d3805950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:45Z,use_quota=True,user_id='3f51b78b873b441bbc04af65c726989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Creating volume ed670fca-d2ea-4760-b216-9b20b1fc9d1a {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:49 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8295c183-335a-45a4-8d42-74dcc99b20bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23e4888-011f-4705-ad5a-b4958ae60a3f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:49 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a 1073741824
Apr 15 23:23:49 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420bc4e5-714a-44b9-8e26-1c647c307aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:49 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Volume volume-b23e4888-011f-4705-ad5a-b4958ae60a3f (b23e4888-011f-4705-ad5a-b4958ae60a3f): created successfully
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420bc4e5-714a-44b9-8e26-1c647c307aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Flow 'volume_create_manager' (fc3d22f1-a3c2-40fd-b86a-ea43798bc857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:49 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a346dad1-0212-485d-9e76-ef285acfda91 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created volume successfully.
Apr 15 23:23:49 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a 1073741824" returned: 0 in 0.466s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:49 devstack sudo[88338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a
Apr 15 23:23:49 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:50 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a" returned: 0 in 0.408s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2762f51-cbef-429f-a0af-8ac55e64a3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe8335c-c238-40d7-ae24-a867fd7ae5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:50 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Volume volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a (ed670fca-d2ea-4760-b216-9b20b1fc9d1a): created successfully
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe8335c-c238-40d7-ae24-a867fd7ae5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Flow 'volume_create_manager' (7e5b8e39-7adb-41a5-a563-b70775345e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:50 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-19b70cb1-cdd8-4b36-9542-0cbacbaf1b44 tempest-VolumesGetTest-1171497064 None] Created volume successfully.
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-b23e4888-011f-4705-ad5a-b4958ae60a3f-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-b23e4888-011f-4705-ad5a-b4958ae60a3f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-quobyte-b23e4888-011f-4705-ad5a-b4958ae60a3f" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-b23e4888-011f-4705-ad5a-b4958ae60a3f" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[73952cad-9c43-4c4a-bc8c-063f9da87e59]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:50 devstack sudo[88341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f
Apr 15 23:23:50 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-ed670fca-d2ea-4760-b216-9b20b1fc9d1a-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Lock "cinder-ed670fca-d2ea-4760-b216-9b20b1fc9d1a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-ed670fca-d2ea-4760-b216-9b20b1fc9d1a" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-ed670fca-d2ea-4760-b216-9b20b1fc9d1a" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a65f081-4db9-423f-aead-efad108c212a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:50 devstack sudo[88344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a
Apr 15 23:23:50 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:50 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f" returned: 0 in 0.517s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:50 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f
Apr 15 23:23:50 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:51 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a" returned: 0 in 0.454s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:51 devstack sudo[88354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a
Apr 15 23:23:51 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:51 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b23e4888-011f-4705-ad5a-b4958ae60a3f" returned: 0 in 0.399s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-b23e4888-011f-4705-ad5a-b4958ae60a3f" released by "delete_volume" :: held 0.949s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created reservations ['0a2fe89f-f11f-46e9-9a48-0a1307a8b22b', 'eb7d9b34-3755-4c7a-8f6d-cbb66fe3dcb1', '08f58fd7-91ed-4b72-9c35-5f29eb02d4a6', '2e59a8e1-4f03-483b-b8e7-bce4f3b19e09'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:51 devstack sudo[88356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:51 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-d2ef1243-3d98-4b16-b372-e902a202fe14-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-d2ef1243-3d98-4b16-b372-e902a202fe14-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-quobyte-d2ef1243-3d98-4b16-b372-e902a202fe14" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-d2ef1243-3d98-4b16-b372-e902a202fe14" acquired by "delete_volume" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[51122c96-5bad-4b59-bb43-ca034eb86bd8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:51 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14
Apr 15 23:23:51 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:51 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-ed670fca-d2ea-4760-b216-9b20b1fc9d1a" returned: 0 in 0.493s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-ed670fca-d2ea-4760-b216-9b20b1fc9d1a" released by "delete_volume" :: held 0.974s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Created reservations ['1868f79f-88d7-4ac2-91e9-d542d98bb3b7', '8a104ef9-bf06-419c-a3b6-2b681dc2029d', '0b65fa27-0b9b-456c-bea9-6db727bf27fa', '8b7bd156-39b2-46ce-901b-f1bc9c783511'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:51 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.479s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Deleted volume successfully.
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-53d99a36-9e3f-4490-ae3e-79c0910489d1 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-b23e4888-011f-4705-ad5a-b4958ae60a3f-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:51 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:51 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:51 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14" returned: 0 in 0.532s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:51 devstack sudo[88367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14
Apr 15 23:23:51 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:52 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.500s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:52 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Deleted volume successfully.
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6c48f130-6b95-4a5e-a464-94ebcfe9a1fc tempest-VolumesGetTest-1171497064 None] Lock "cinder-ed670fca-d2ea-4760-b216-9b20b1fc9d1a-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:52 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d2ef1243-3d98-4b16-b372-e902a202fe14" returned: 0 in 0.449s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-d2ef1243-3d98-4b16-b372-e902a202fe14" released by "delete_volume" :: held 1.012s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created reservations ['e85113b0-2b8a-4f4b-b7ea-f10f281814b0', '15e4cf54-2f96-4e89-9cbc-81609cd56ee6', '404486c5-476c-4f2f-b961-bef2d5eda295', '772f0c67-4811-4359-adf9-bf4e0985992f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:52 devstack sudo[88371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:52 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-367d57ee-dd18-4470-a6d1-c6b3c23033d8-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Lock "cinder-367d57ee-dd18-4470-a6d1-c6b3c23033d8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:52 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.443s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Acquiring lock "cinder-quobyte-367d57ee-dd18-4470-a6d1-c6b3c23033d8" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:52 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Deleted volume successfully.
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-367d57ee-dd18-4470-a6d1-c6b3c23033d8" acquired by "delete_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8857816-7944-40bc-be66-274cb247c978 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-d2ef1243-3d98-4b16-b372-e902a202fe14-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4602f95a-cd15-456b-be83-9e00e386029f]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:53 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8
Apr 15 23:23:53 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-44c140a8-cb01-4004-b940-2a3280c870bd-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-44c140a8-cb01-4004-b940-2a3280c870bd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:53 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8" returned: 0 in 0.576s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-quobyte-44c140a8-cb01-4004-b940-2a3280c870bd" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-44c140a8-cb01-4004-b940-2a3280c870bd" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f800f0c-9285-41d1-8bdf-8a3a12a41665]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:53 devstack sudo[88378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8
Apr 15 23:23:53 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:53 devstack sudo[88379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd
Apr 15 23:23:53 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:54 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8" returned: 1 in 0.556s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:54 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd" returned: 0 in 0.552s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:54 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8
Apr 15 23:23:54 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:54 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd
Apr 15 23:23:54 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:54 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-44c140a8-cb01-4004-b940-2a3280c870bd" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-44c140a8-cb01-4004-b940-2a3280c870bd" released by "delete_volume" :: held 0.993s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:54 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-367d57ee-dd18-4470-a6d1-c6b3c23033d8" returned: 0 in 0.487s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Lock "cinder-quobyte-367d57ee-dd18-4470-a6d1-c6b3c23033d8" released by "delete_volume" :: held 1.676s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created reservations ['1d7657d4-d099-428b-bfca-59b2a348d1d9', '9a26b894-6ed5-4dfb-8731-04170d08b03b', 'd7ea0d17-e379-42e7-9b84-726a1e1a4204', '069918ff-b346-42bb-bbc3-db1ab6fdaa1d'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Created reservations ['28000889-e4ba-4c59-94e5-b76f55d97237', '607f3b64-48ae-4d53-8104-1b8fc248ae1e', '7a331bbc-3a3b-4e83-aa4f-b26dd0a07690', 'c29048fb-83cb-4acc-946d-ff41c64aa383'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:54 devstack sudo[88394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:54 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:54 devstack sudo[88396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:54 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:55 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.492s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:55 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Deleted volume successfully.
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Deleted volume successfully.
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd165d80-bcf3-47b7-9515-a5eb5d455923 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-44c140a8-cb01-4004-b940-2a3280c870bd-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-812030ef-954f-480e-8d6c-d0f75bc869ad tempest-VolumesGetTest-1171497064 None] Lock "cinder-367d57ee-dd18-4470-a6d1-c6b3c23033d8-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-5810af64-d5f4-4d31-b9ad-21548606a69b-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-5810af64-d5f4-4d31-b9ad-21548606a69b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-quobyte-5810af64-d5f4-4d31-b9ad-21548606a69b" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-5810af64-d5f4-4d31-b9ad-21548606a69b" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[153fc7fc-8a19-41b5-bb99-26b5fd81bdc4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:55 devstack sudo[88401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b
Apr 15 23:23:55 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:56 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b" returned: 0 in 0.517s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:56 devstack sudo[88406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b
Apr 15 23:23:56 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:56 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-5810af64-d5f4-4d31-b9ad-21548606a69b" returned: 0 in 0.495s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-5810af64-d5f4-4d31-b9ad-21548606a69b" released by "delete_volume" :: held 1.036s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created reservations ['a693b5db-fd6f-4d4a-9c3c-0a2d3659da75', '12ad4919-a1e6-4d90-ac6b-7cf16b0459f8', 'e6490b50-e8e7-45d2-b49f-26dcda8a1c8c', '888ab0b4-e89c-4896-af8b-f4065a46bcab'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:56 devstack sudo[88409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:56 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:57 devstack sudo[88411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:57 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:57 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.498s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Deleted volume successfully.
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfab3939-e7c0-4aac-917d-3835f43db166 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-5810af64-d5f4-4d31-b9ad-21548606a69b-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:57 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.495s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-bb82bf95-7fbd-44a1-a4b1-a26677849d28-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-bb82bf95-7fbd-44a1-a4b1-a26677849d28-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-quobyte-bb82bf95-7fbd-44a1-a4b1-a26677849d28" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-bb82bf95-7fbd-44a1-a4b1-a26677849d28" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bb6f2d-8fb8-4280-b907-84cce279e906]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:23:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:58 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28
Apr 15 23:23:58 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:58 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28" returned: 0 in 0.531s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:58 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28
Apr 15 23:23:58 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:58 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-bb82bf95-7fbd-44a1-a4b1-a26677849d28" returned: 0 in 0.440s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-bb82bf95-7fbd-44a1-a4b1-a26677849d28" released by "delete_volume" :: held 0.999s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created reservations ['7da57b34-c340-4184-8cb0-e4253572b96b', 'd6aefb69-c20b-4baf-a962-18c9eb4e5984', '11cc7c86-68d8-4e4c-bcd1-6cbe607ce0f1', '808e0269-4696-42d4-b11b-528cbd73d8cf'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:23:59 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:23:59 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Flow 'volume_create_manager' (565f589f-7db4-49ea-9de2-17f0513ecb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97816d90-19a5-414e-aade-55b578dbbb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97816d90-19a5-414e-aade-55b578dbbb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1968208479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4960cad-ce82-42c4-ba1f-3dc6643d1626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a860c28eadc44a538dac0177664a59c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:59Z,use_quota=True,user_id='b30ee51d67d748ae832d8bd8b90d9da1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f86c23e-2b55-43a9-81c8-9d531e1a1fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f86c23e-2b55-43a9-81c8-9d531e1a1fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2601586d-f2e6-4caf-a074-7e71fc8713c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2601586d-f2e6-4caf-a074-7e71fc8713c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4960cad-ce82-42c4-ba1f-3dc6643d1626', 'volume_name': 'volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626', 'volume_size': 2}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94486898-4f16-4662-a302-4f7ea48d5c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94486898-4f16-4662-a302-4f7ea48d5c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe70601-5fd0-4f2d-bd88-fc94b97d81ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:23:59 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Volume c4960cad-ce82-42c4-ba1f-3dc6643d1626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626', 'volume_size': 2}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1968208479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4960cad-ce82-42c4-ba1f-3dc6643d1626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a860c28eadc44a538dac0177664a59c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:59Z,use_quota=True,user_id='b30ee51d67d748ae832d8bd8b90d9da1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Creating volume c4960cad-ce82-42c4-ba1f-3dc6643d1626 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:23:59 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 2147483648 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:59 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 2147483648
Apr 15 23:23:59 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:23:59 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.436s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:23:59 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Deleted volume successfully.
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9510c140-f17b-4abc-8754-2fbc65033176 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-bb82bf95-7fbd-44a1-a4b1-a26677849d28-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:23:59 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 2147483648" returned: 0 in 0.513s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:23:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:23:59 devstack sudo[88431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626
Apr 15 23:23:59 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-38cef2e0-655c-432a-abea-1d57561e0624-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-38cef2e0-655c-432a-abea-1d57561e0624-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "cinder-quobyte-38cef2e0-655c-432a-abea-1d57561e0624" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-38cef2e0-655c-432a-abea-1d57561e0624" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c48508-69da-4e50-a892-dd52d47693ea]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:00 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626" returned: 0 in 0.561s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:00 devstack sudo[88434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:24:00 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe70601-5fd0-4f2d-bd88-fc94b97d81ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626', 'volume_size': 2}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04397ef8-5a3d-4d35-b921-05e187e4705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:00 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Volume volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 (c4960cad-ce82-42c4-ba1f-3dc6643d1626): created successfully
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04397ef8-5a3d-4d35-b921-05e187e4705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Flow 'volume_create_manager' (565f589f-7db4-49ea-9de2-17f0513ecb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:00 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-7b4a323d-53f8-4443-a589-cdbba5ec8c77 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Created volume successfully.
Apr 15 23:24:00 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624" returned: 0 in 0.499s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:00 devstack sudo[88439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624
Apr 15 23:24:00 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:01 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-38cef2e0-655c-432a-abea-1d57561e0624" returned: 0 in 0.428s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-quobyte-38cef2e0-655c-432a-abea-1d57561e0624" released by "delete_volume" :: held 0.959s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Created reservations ['f9d08948-7013-498e-bfbc-22896982164a', '41822394-42d6-47e2-91c9-406a5aca40a6', '255ffde2-72d6-450c-ab5e-dd9639aaaef5', 'acf9bce8-37dd-4c1c-b921-8d06cf9a90b7'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:01 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:01 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Creating offline snapshot 1f6ad52c-f7f8-4b80-96d7-a9681e4b177d of volume c4960cad-ce82-42c4-ba1f-3dc6643d1626 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03c6194-98f9-4a97-bd33-20e60f866f39]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:01 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626
Apr 15 23:24:01 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:01 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.610s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:01 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Deleted volume successfully.
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cdb53324-cf04-49d1-bff0-fce9e3fcd348 tempest-CreateVolumesFromSourceVolumeTest-532858039 None] Lock "cinder-38cef2e0-655c-432a-abea-1d57561e0624-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:01 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626" returned: 0 in 0.619s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d 2G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:02 devstack sudo[88450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d 2G
Apr 15 23:24:02 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:02 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d 2G" returned: 0 in 0.640s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:02 devstack sudo[88455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d
Apr 15 23:24:02 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:03 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d" returned: 0 in 0.587s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:03 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d is being set with open permissions: ugo+rw
Apr 15 23:24:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:03 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d
Apr 15 23:24:03 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:03 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d" returned: 0 in 0.565s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:03 devstack sudo[88463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.info
Apr 15 23:24:03 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Flow 'volume_create_manager' (2711aa56-96f1-4813-a5a7-08aeb2c911c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bca9c9a-1ee5-40f7-8b13-5740417b21b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bca9c9a-1ee5-40f7-8b13-5740417b21b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2069039055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8ccf95-0501-434a-895a-d48cebb15681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccee13ba01d646a78c22c6346fa0411e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:04Z,use_quota=True,user_id='302ab3958cff4fc0a20cf048c30df720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1738c2ac-4e3c-493d-97df-38b482bcf63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1738c2ac-4e3c-493d-97df-38b482bcf63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0e29be-4e52-4905-8fbd-5d4977238f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0e29be-4e52-4905-8fbd-5d4977238f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8ccf95-0501-434a-895a-d48cebb15681', 'volume_name': 'volume-fc8ccf95-0501-434a-895a-d48cebb15681', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc9ff94-5361-4498-a422-96b1992aa6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc9ff94-5361-4498-a422-96b1992aa6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b578677f-4384-4f57-8b19-a388aa35eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:04 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Volume fc8ccf95-0501-434a-895a-d48cebb15681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8ccf95-0501-434a-895a-d48cebb15681', 'volume_size': 1}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:04 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.info" returned: 0 in 0.587s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:04 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.info is being set with open permissions: ugo+rw
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:04 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.info
Apr 15 23:24:04 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:04 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.info" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2069039055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8ccf95-0501-434a-895a-d48cebb15681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccee13ba01d646a78c22c6346fa0411e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:04Z,use_quota=True,user_id='302ab3958cff4fc0a20cf048c30df720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Creating volume fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:24:04 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:24:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:04 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-72909f35-ee34-40af-ba29-cbbae64d333e tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Create snapshot completed successfully
Apr 15 23:24:04 devstack sudo[88469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 1073741824
Apr 15 23:24:04 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:05 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 1073741824" returned: 0 in 0.572s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:05 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681
Apr 15 23:24:05 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "cinder-1f6ad52c-f7f8-4b80-96d7-a9681e4b177d-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-1f6ad52c-f7f8-4b80-96d7-a9681e4b177d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "cinder-quobyte-c4960cad-ce82-42c4-ba1f-3dc6643d1626" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-quobyte-c4960cad-ce82-42c4-ba1f-3dc6643d1626" acquired by "delete_snapshot" :: waited 0.064s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "cinder-quobyte-1f6ad52c-f7f8-4b80-96d7-a9681e4b177d" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-quobyte-1f6ad52c-f7f8-4b80-96d7-a9681e4b177d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Deleting offline snapshot 1f6ad52c-f7f8-4b80-96d7-a9681e4b177d of volume c4960cad-ce82-42c4-ba1f-3dc6643d1626 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] snapshot_file for this snap is: volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[de04964c-137c-408e-90ac-c7c16c2a02f1]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:05 devstack sudo[88477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d
Apr 15 23:24:05 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:05 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681" returned: 0 in 0.466s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b578677f-4384-4f57-8b19-a388aa35eb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8ccf95-0501-434a-895a-d48cebb15681', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4885e8f6-907e-48e2-abda-154a095a10f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:05 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Volume volume-fc8ccf95-0501-434a-895a-d48cebb15681 (fc8ccf95-0501-434a-895a-d48cebb15681): created successfully
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4885e8f6-907e-48e2-abda-154a095a10f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:05 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Flow 'volume_create_manager' (2711aa56-96f1-4813-a5a7-08aeb2c911c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:06 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-dd9c4621-e957-424d-8f4c-899bcecf01be tempest-VolumeDependencyTests-1911795851 None] Created volume successfully.
Apr 15 23:24:06 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d" returned: 0 in 0.550s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c3b83-8db5-4687-b5df-ce757686dc18]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:06 devstack sudo[88483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626
Apr 15 23:24:06 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Creating offline snapshot b69bdda4-365f-4b08-94af-46e9abc4c3f8 of volume fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2e5ab1-6100-4e91-a763-fd420585c081]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:06 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681
Apr 15 23:24:06 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:06 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626" returned: 0 in 0.542s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:06 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d
Apr 15 23:24:06 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:06 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681" returned: 0 in 0.514s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:06 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 1G
Apr 15 23:24:06 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:07 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d" returned: 0 in 0.489s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:07 devstack sudo[88500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d
Apr 15 23:24:07 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:07 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 1G" returned: 0 in 0.576s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8ccf95-0501-434a-895a-d48cebb15681 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:07 devstack sudo[88505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8ccf95-0501-434a-895a-d48cebb15681 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8
Apr 15 23:24:07 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:07 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626.1f6ad52c-f7f8-4b80-96d7-a9681e4b177d" returned: 0 in 0.515s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-quobyte-1f6ad52c-f7f8-4b80-96d7-a9681e4b177d" released by "_delete_snapshot" :: held 2.158s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-quobyte-c4960cad-ce82-42c4-ba1f-3dc6643d1626" released by "delete_snapshot" :: held 2.168s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Created reservations ['2dd2a59e-e39a-4890-ac6f-70eb3a31ed92', '3f5792f5-693c-4c87-8ed9-20c3d1e92e8c', '0bf519f7-3cc9-4f45-a4c0-9ff4b26afbaf', '45240e96-5984-4eb7-b101-1117bb6b2714'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:07 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Delete snapshot completed successfully.
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-0dc6f1f2-c732-4003-bb87-081b5ade9672 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-1f6ad52c-f7f8-4b80-96d7-a9681e4b177d-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:07 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8ccf95-0501-434a-895a-d48cebb15681 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8" returned: 0 in 0.473s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:07 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 is being set with open permissions: ugo+rw
Apr 15 23:24:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:07 devstack sudo[88511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8
Apr 15 23:24:07 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:08 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8" returned: 0 in 0.480s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:08 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.info
Apr 15 23:24:08 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "cinder-c4960cad-ce82-42c4-ba1f-3dc6643d1626-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-c4960cad-ce82-42c4-ba1f-3dc6643d1626-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "cinder-quobyte-c4960cad-ce82-42c4-ba1f-3dc6643d1626" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-quobyte-c4960cad-ce82-42c4-ba1f-3dc6643d1626" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af5ce78-1134-4999-aad6-f4e46c4eb574]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:08 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.info" returned: 0 in 0.533s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:08 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.info is being set with open permissions: ugo+rw
Apr 15 23:24:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:09 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.info
Apr 15 23:24:09 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:09 devstack sudo[88517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626
Apr 15 23:24:09 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:09 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.info" returned: 0 in 0.606s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.251s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:09 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3746e9e4-6cc2-4e5d-b406-18e3452f949a tempest-VolumeDependencyTests-1911795851 None] Create snapshot completed successfully
Apr 15 23:24:09 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626" returned: 0 in 0.757s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:09 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626
Apr 15 23:24:09 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:10 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-c4960cad-ce82-42c4-ba1f-3dc6643d1626" returned: 0 in 0.522s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-quobyte-c4960cad-ce82-42c4-ba1f-3dc6643d1626" released by "delete_volume" :: held 1.317s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Created reservations ['0a2d5a3f-61a8-4fb0-a81a-954b7cd8ac98', '4631659b-e7a8-49e5-8118-47ee7e1ef95c', '8cf1dcae-80f9-46f1-8272-88dbd0f4f832', '2b5470dd-5efc-4931-b85c-4b049c9ec71a'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:10 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:10 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:10 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.505s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:10 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Deleted volume successfully.
Apr 15 23:24:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6dca3b82-7b1c-432f-a4dc-ffdd6a2cdbb8 tempest-VolumesSnapshotNegativeTestJSON-1354412450 None] Lock "cinder-c4960cad-ce82-42c4-ba1f-3dc6643d1626-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Flow 'volume_create_manager' (9a7e5bb5-d6e9-4e32-82cd-8a1401b06720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a792bf5-783c-48e9-86ad-6056aa4c77fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a792bf5-783c-48e9-86ad-6056aa4c77fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1373911031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b33567-0d3a-4336-a104-b47f82ee5af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccee13ba01d646a78c22c6346fa0411e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b69bdda4-365f-4b08-94af-46e9abc4c3f8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:11Z,use_quota=True,user_id='302ab3958cff4fc0a20cf048c30df720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bfd66e-ce1b-4a22-afd9-b993eed1b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bfd66e-ce1b-4a22-afd9-b993eed1b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6021ee9-5463-4046-b332-f7031fb17fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6021ee9-5463-4046-b332-f7031fb17fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83b33567-0d3a-4336-a104-b47f82ee5af5', 'volume_name': 'volume-83b33567-0d3a-4336-a104-b47f82ee5af5', 'volume_size': 1, 'snapshot_id': 'b69bdda4-365f-4b08-94af-46e9abc4c3f8'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82da219f-393b-4673-ad04-959f19fda4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82da219f-393b-4673-ad04-959f19fda4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba5aa94-effc-4d4d-afc2-8e908f89dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:11 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Volume 83b33567-0d3a-4336-a104-b47f82ee5af5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83b33567-0d3a-4336-a104-b47f82ee5af5', 'volume_size': 1, 'snapshot_id': 'b69bdda4-365f-4b08-94af-46e9abc4c3f8'}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-b69bdda4-365f-4b08-94af-46e9abc4c3f8-83b33567-0d3a-4336-a104-b47f82ee5af5" by "_create_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-b69bdda4-365f-4b08-94af-46e9abc4c3f8-83b33567-0d3a-4336-a104-b47f82ee5af5" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Creating volume 83b33567-0d3a-4336-a104-b47f82ee5af5 from snapshot b69bdda4-365f-4b08-94af-46e9abc4c3f8 {{(pid=81941) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-83b33567-0d3a-4336-a104-b47f82ee5af5" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-83b33567-0d3a-4336-a104-b47f82ee5af5" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] snapshot: b69bdda4-365f-4b08-94af-46e9abc4c3f8, volume: 83b33567-0d3a-4336-a104-b47f82ee5af5,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2afe8c-6575-4eeb-bf61-7851ba3702b2]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:11 devstack sudo[88533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8
Apr 15 23:24:11 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:11 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8" returned: 0 in 0.665s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc8ccf95-0501-434a-895a-d48cebb15681(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa77df6-e562-43ee-be72-dd4468c97f80]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:12 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681
Apr 15 23:24:12 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:12 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681" returned: 0 in 0.559s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:12 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:24:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:12 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5
Apr 15 23:24:12 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:14 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5" returned: 0 in 2.264s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:14 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7c1912-a4d6-40cb-8031-20e2ead2a142]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:14 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681
Apr 15 23:24:14 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:15 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681" returned: 0 in 0.662s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:24:15 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Converted 1024.00 MB image at 452.16 MB/s
Apr 15 23:24:15 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5 is being set with open permissions: ugo+rw
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:15 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5
Apr 15 23:24:15 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:15 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5" returned: 0 in 0.442s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-83b33567-0d3a-4336-a104-b47f82ee5af5" released by "_copy_volume_from_snapshot" :: held 4.661s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-b69bdda4-365f-4b08-94af-46e9abc4c3f8-83b33567-0d3a-4336-a104-b47f82ee5af5" released by "_create_volume_from_snapshot" :: held 4.680s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.691s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba5aa94-effc-4d4d-afc2-8e908f89dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b33567-0d3a-4336-a104-b47f82ee5af5', 'volume_size': 1, 'snapshot_id': 'b69bdda4-365f-4b08-94af-46e9abc4c3f8'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fa0fcc-85f3-4e8e-a3a2-c45363625664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:15 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Volume volume-83b33567-0d3a-4336-a104-b47f82ee5af5 (83b33567-0d3a-4336-a104-b47f82ee5af5): created successfully
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fa0fcc-85f3-4e8e-a3a2-c45363625664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:15 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Flow 'volume_create_manager' (9a7e5bb5-d6e9-4e32-82cd-8a1401b06720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:15 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3a5e4460-7139-4c75-8ddc-e12827a982a3 tempest-VolumeDependencyTests-1911795851 None] Created volume successfully.
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-b69bdda4-365f-4b08-94af-46e9abc4c3f8-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-b69bdda4-365f-4b08-94af-46e9abc4c3f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-fc8ccf95-0501-434a-895a-d48cebb15681" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-fc8ccf95-0501-434a-895a-d48cebb15681" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-b69bdda4-365f-4b08-94af-46e9abc4c3f8" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-b69bdda4-365f-4b08-94af-46e9abc4c3f8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Deleting offline snapshot b69bdda4-365f-4b08-94af-46e9abc4c3f8 of volume fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] snapshot_file for this snap is: volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d41fa3-a189-4961-88f3-e24ab3bb1583]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:16 devstack sudo[88570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8
Apr 15 23:24:16 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:17 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8" returned: 0 in 0.559s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc8ccf95-0501-434a-895a-d48cebb15681(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:24:17 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e8a7cf-f801-4b1a-89e1-848632715c7c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:17 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681
Apr 15 23:24:17 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:17 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681" returned: 0 in 0.539s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:17 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8
Apr 15 23:24:17 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:18 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8" returned: 0 in 0.494s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:18 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8
Apr 15 23:24:18 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:18 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681.b69bdda4-365f-4b08-94af-46e9abc4c3f8" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-b69bdda4-365f-4b08-94af-46e9abc4c3f8" released by "_delete_snapshot" :: held 2.106s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-fc8ccf95-0501-434a-895a-d48cebb15681" released by "delete_snapshot" :: held 2.119s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:18 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Created reservations ['fe34e498-4d2b-464b-bde7-3459b798a286', 'e821f99c-744b-41df-a191-0a294e945a56', '4142c1a9-b686-4aa5-9b62-86640fa7bb07', '13e31699-5277-4cf2-b819-504df2fb863b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:18 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Delete snapshot completed successfully.
Apr 15 23:24:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1b3096a6-63dc-42e6-990c-e71b3d66e4ef tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-b69bdda4-365f-4b08-94af-46e9abc4c3f8-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:19 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-fc8ccf95-0501-434a-895a-d48cebb15681-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:19 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-fc8ccf95-0501-434a-895a-d48cebb15681-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:19 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-fc8ccf95-0501-434a-895a-d48cebb15681" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:19 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-fc8ccf95-0501-434a-895a-d48cebb15681" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:19 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4133a77-bf0b-447d-a065-8e635bb0770e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:19 devstack sudo[88604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681
Apr 15 23:24:19 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:20 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681" returned: 0 in 0.505s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:20 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681
Apr 15 23:24:20 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:20 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-fc8ccf95-0501-434a-895a-d48cebb15681" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-fc8ccf95-0501-434a-895a-d48cebb15681" released by "delete_volume" :: held 0.988s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Created reservations ['f4c9db8e-e659-45fe-a7ba-4ae8bd169915', '42387731-9bd0-4534-a535-fa874a581e3a', '54f61666-9407-4eb5-bb37-48401cd3ffcd', 'f56ce766-fc8f-487c-a2ba-ae0ef3c9577a'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:20 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:20 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Flow 'volume_create_manager' (e331ea44-70af-493c-80ac-83a0913a279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668aae9e-7eba-422c-a41a-8fdc1f2dd949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668aae9e-7eba-422c-a41a-8fdc1f2dd949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1316793687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b829a0d3-efd6-4a0a-bbb0-5f909580fedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccee13ba01d646a78c22c6346fa0411e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:21Z,use_quota=True,user_id='302ab3958cff4fc0a20cf048c30df720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951d792b-4970-4ee5-a611-b896e171e82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951d792b-4970-4ee5-a611-b896e171e82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae28003d-ebaa-4472-8c31-e75b2382f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae28003d-ebaa-4472-8c31-e75b2382f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b829a0d3-efd6-4a0a-bbb0-5f909580fedc', 'volume_name': 'volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de774247-09b0-4fd5-8b7c-818c3029a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de774247-09b0-4fd5-8b7c-818c3029a67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cec767-1c9e-4970-8407-64ecf22c86d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:21 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Volume b829a0d3-efd6-4a0a-bbb0-5f909580fedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc', 'volume_size': 1}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1316793687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b829a0d3-efd6-4a0a-bbb0-5f909580fedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccee13ba01d646a78c22c6346fa0411e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:21Z,use_quota=True,user_id='302ab3958cff4fc0a20cf048c30df720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Creating volume b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:24:21 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:21 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc 1073741824
Apr 15 23:24:21 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:21 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.499s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:21 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Deleted volume successfully.
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8a7467e7-34dc-4a08-8d89-678688aef8c6 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-fc8ccf95-0501-434a-895a-d48cebb15681-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:21 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc 1073741824" returned: 0 in 0.526s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:21 devstack sudo[88623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc
Apr 15 23:24:21 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:22 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:24:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cec767-1c9e-4970-8407-64ecf22c86d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2298a8-beb3-43f6-881a-67705782e6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:22 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Volume volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc (b829a0d3-efd6-4a0a-bbb0-5f909580fedc): created successfully
Apr 15 23:24:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2298a8-beb3-43f6-881a-67705782e6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Flow 'volume_create_manager' (e331ea44-70af-493c-80ac-83a0913a279a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:22 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-62a6a097-ec25-48dc-a130-293c2f2e925b tempest-VolumeDependencyTests-1911795851 None] Created volume successfully.
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Flow 'volume_create_manager' (633d86b3-b7da-4572-92fc-cabbeae2884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d70442b-2cde-46b5-9159-6a8a2ea1f687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d70442b-2cde-46b5-9159-6a8a2ea1f687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-185340449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d221b7-7b07-4152-aab5-91227b180691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccee13ba01d646a78c22c6346fa0411e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b829a0d3-efd6-4a0a-bbb0-5f909580fedc,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:23Z,use_quota=True,user_id='302ab3958cff4fc0a20cf048c30df720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133a6c9a-9dfc-4dad-af24-7c572aad3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133a6c9a-9dfc-4dad-af24-7c572aad3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f69e677-2c4f-4c04-84a8-ae0ed41524f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f69e677-2c4f-4c04-84a8-ae0ed41524f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '06d221b7-7b07-4152-aab5-91227b180691', 'volume_name': 'volume-06d221b7-7b07-4152-aab5-91227b180691', 'volume_size': 1, 'source_volid': 'b829a0d3-efd6-4a0a-bbb0-5f909580fedc', 'source_volstatus': 'available'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52f82aa-ec30-4c3e-8862-515f3df16934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52f82aa-ec30-4c3e-8862-515f3df16934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80beded-8102-4baa-b7fc-a0b68f9e8ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:23 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Volume 06d221b7-7b07-4152-aab5-91227b180691: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-06d221b7-7b07-4152-aab5-91227b180691', 'volume_size': 1, 'source_volid': 'b829a0d3-efd6-4a0a-bbb0-5f909580fedc', 'source_volstatus': 'available'}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:23 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Cloning volume b829a0d3-efd6-4a0a-bbb0-5f909580fedc to volume 06d221b7-7b07-4152-aab5-91227b180691
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Creating offline snapshot 7742172f-79bc-41e4-b478-6e747e0ade6e of volume b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[399b29aa-1333-46d4-8849-8771b17ea289]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:23 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc
Apr 15 23:24:23 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:24 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" returned: 0 in 0.618s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:24 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e 1G
Apr 15 23:24:24 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:24 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e 1G" returned: 0 in 0.612s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:24 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e
Apr 15 23:24:24 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:25 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e" returned: 0 in 0.511s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:25 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e is being set with open permissions: ugo+rw
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:25 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e
Apr 15 23:24:25 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (1e8a780d-00a6-4298-8e02-d348eecd7532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1019c2e3-f740-4a4f-9310-fda4ee0a1df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1019c2e3-f740-4a4f-9310-fda4ee0a1df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600001521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb19835d-e66c-41dd-a68b-2ac7f5e54385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:26Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc656793-175f-4093-8bec-14f918145026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc656793-175f-4093-8bec-14f918145026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e260c257-a5ae-45e0-a7b3-4e56836b774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e260c257-a5ae-45e0-a7b3-4e56836b774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb19835d-e66c-41dd-a68b-2ac7f5e54385', 'volume_name': 'volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71684c83-f6ab-4097-82fa-1606529b3602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71684c83-f6ab-4097-82fa-1606529b3602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6c1b95-24fa-452f-91d6-89af897b9c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:25 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Volume eb19835d-e66c-41dd-a68b-2ac7f5e54385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385', 'volume_size': 1}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:25 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e" returned: 0 in 0.450s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:25 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.info
Apr 15 23:24:25 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:26 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.info" returned: 0 in 0.437s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:26 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.info is being set with open permissions: ugo+rw
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:26 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.info
Apr 15 23:24:26 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:26 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.info" returned: 0 in 0.395s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-06d221b7-7b07-4152-aab5-91227b180691" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-06d221b7-7b07-4152-aab5-91227b180691" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] snapshot: 7742172f-79bc-41e4-b478-6e747e0ade6e, volume: 06d221b7-7b07-4152-aab5-91227b180691,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7db48a4-6870-4a19-8191-73e44bbfb741]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:26 devstack sudo[88679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e
Apr 15 23:24:26 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:27 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e" returned: 0 in 0.462s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[effbf7e9-9ef7-44ec-9c09-2031d2811456]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:27 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc
Apr 15 23:24:27 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:27 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" returned: 0 in 0.501s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:24:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:27 devstack sudo[88689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691
Apr 15 23:24:27 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:30 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691" returned: 0 in 2.467s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:30 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[76849f33-0c80-4cce-ad5a-a5810e7fa2d9]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:30 devstack sudo[88701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc
Apr 15 23:24:30 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:30 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" returned: 0 in 0.615s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:30 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:24:30 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Converted 1024.00 MB image at 414.90 MB/s
Apr 15 23:24:30 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691 is being set with open permissions: ugo+rw
Apr 15 23:24:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:30 devstack sudo[88706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691
Apr 15 23:24:30 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:31 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691" returned: 0 in 0.434s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-06d221b7-7b07-4152-aab5-91227b180691" released by "_copy_volume_from_snapshot" :: held 4.527s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:UPDATE=236,cinder:SELECT=192,cinder:INSERT=68,cinder:DELETE=7 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-7742172f-79bc-41e4-b478-6e747e0ade6e" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-7742172f-79bc-41e4-b478-6e747e0ade6e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Deleting offline snapshot 7742172f-79bc-41e4-b478-6e747e0ade6e of volume b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] snapshot_file for this snap is: volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0041fc-6220-4440-9a6e-c882151d5e73]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:31 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e
Apr 15 23:24:31 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:31 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e" returned: 0 in 0.498s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[032368b9-150c-414e-98fa-a7a8a26103dc]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:31 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc
Apr 15 23:24:31 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:32 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" returned: 0 in 0.488s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:32 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e
Apr 15 23:24:32 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:32 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e" returned: 0 in 0.468s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:32 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e
Apr 15 23:24:32 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:33 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc.7742172f-79bc-41e4-b478-6e747e0ade6e" returned: 0 in 0.440s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-7742172f-79bc-41e4-b478-6e747e0ade6e" released by "_delete_snapshot" :: held 1.942s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.631s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.507s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600001521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb19835d-e66c-41dd-a68b-2ac7f5e54385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:26Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Creating volume eb19835d-e66c-41dd-a68b-2ac7f5e54385 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:24:33 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80beded-8102-4baa-b7fc-a0b68f9e8ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d221b7-7b07-4152-aab5-91227b180691', 'volume_size': 1, 'source_volid': 'b829a0d3-efd6-4a0a-bbb0-5f909580fedc', 'source_volstatus': 'available'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:33 devstack sudo[88733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385 1073741824
Apr 15 23:24:33 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f974446-7274-48b7-9cb8-ce4bb2628967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:33 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Volume volume-06d221b7-7b07-4152-aab5-91227b180691 (06d221b7-7b07-4152-aab5-91227b180691): created successfully
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f974446-7274-48b7-9cb8-ce4bb2628967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Flow 'volume_create_manager' (633d86b3-b7da-4572-92fc-cabbeae2884f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:33 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-33ebcd3b-3160-4f66-9ba3-7b12ebceb0e7 tempest-VolumeDependencyTests-1911795851 None] Created volume successfully.
Apr 15 23:24:33 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385 1073741824" returned: 0 in 0.485s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:33 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385
Apr 15 23:24:33 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:34 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385" returned: 0 in 0.426s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6c1b95-24fa-452f-91d6-89af897b9c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b7b980-a379-48ac-8159-623dd8ec6306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:34 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Volume volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385 (eb19835d-e66c-41dd-a68b-2ac7f5e54385): created successfully
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b7b980-a379-48ac-8159-623dd8ec6306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (1e8a780d-00a6-4298-8e02-d348eecd7532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-234cd855-0f15-4266-af34-91af32b7717c tempest-VolumesActionsTest-1659682262 None] Created volume successfully.
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-35829151-2d75-4048-a621-b7929e12d5b4 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385" by "attach_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-35829151-2d75-4048-a621-b7929e12d5b4 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385" acquired by "attach_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-b829a0d3-efd6-4a0a-bbb0-5f909580fedc-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-35829151-2d75-4048-a621-b7929e12d5b4 tempest-VolumesActionsTest-1659682262 None] Attaching volume eb19835d-e66c-41dd-a68b-2ac7f5e54385 to instance 4cc35194-3df7-47f1-b01e-131bce3c5c10 at mountpoint /dev/vdb on host None.
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-b829a0d3-efd6-4a0a-bbb0-5f909580fedc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-35829151-2d75-4048-a621-b7929e12d5b4 tempest-VolumesActionsTest-1659682262 None] Attach volume completed successfully.
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-35829151-2d75-4048-a621-b7929e12d5b4 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385" released by "attach_volume" :: held 0.103s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" acquired by "delete_volume" :: waited 0.017s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d3683-758d-4b65-a75e-db24a6df19e7]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:34 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc
Apr 15 23:24:34 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:34 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" returned: 0 in 0.554s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:34 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc
Apr 15 23:24:34 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-25c5ef2c-8549-4d96-8275-68b36852f2d5 tempest-VolumesActionsTest-1230453639 None] Terminate volume connection completed successfully.
Apr 15 23:24:35 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" returned: 0 in 0.478s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-b829a0d3-efd6-4a0a-bbb0-5f909580fedc" released by "delete_volume" :: held 1.063s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Created reservations ['65f21462-d24f-4b7f-8ed9-ab35028e4a9e', '0d0df6f9-99f4-49e2-940a-475683981ba8', '9c94b08f-789e-4372-8d82-72909e605eef', 'ef01c050-b6a6-4a06-a953-cbf5d5d39220'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:35 devstack sudo[88750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:35 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-25c5ef2c-8549-4d96-8275-68b36852f2d5 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-detach_volume" by "detach_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-25c5ef2c-8549-4d96-8275-68b36852f2d5 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-25c5ef2c-8549-4d96-8275-68b36852f2d5 tempest-VolumesActionsTest-1230453639 None] Detaching volume eb19835d-e66c-41dd-a68b-2ac7f5e54385 from instance 4cc35194-3df7-47f1-b01e-131bce3c5c10.
Apr 15 23:24:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-25c5ef2c-8549-4d96-8275-68b36852f2d5 tempest-VolumesActionsTest-1230453639 None] Detach volume completed successfully.
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-25c5ef2c-8549-4d96-8275-68b36852f2d5 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:35 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.426s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Deleted volume successfully.
Apr 15 23:24:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-205106ec-5eff-4fe2-ac23-a2fa589ea7c7 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-b829a0d3-efd6-4a0a-bbb0-5f909580fedc-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-7a3a928a-3727-4509-822c-b3ad1fb11530 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-detach_volume" by "detach_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-7a3a928a-3727-4509-822c-b3ad1fb11530 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-7a3a928a-3727-4509-822c-b3ad1fb11530 tempest-VolumesActionsTest-1659682262 None] Volume detach called, but volume not attached.
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-7a3a928a-3727-4509-822c-b3ad1fb11530 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-06d221b7-7b07-4152-aab5-91227b180691-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-06d221b7-7b07-4152-aab5-91227b180691-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-06d221b7-7b07-4152-aab5-91227b180691" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-06d221b7-7b07-4152-aab5-91227b180691" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4e8ad1-f292-43b2-bd47-54f0e4f4fdd3]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:36 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691
Apr 15 23:24:36 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:36 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:UPDATE=183,cinder:SELECT=139,cinder:INSERT=48,cinder:DELETE=22 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "cinder-quobyte-eb19835d-e66c-41dd-a68b-2ac7f5e54385" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-quobyte-eb19835d-e66c-41dd-a68b-2ac7f5e54385" acquired by "delete_volume" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[17415f9c-6760-42c4-a2fa-798704a2cb38]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:37 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691" returned: 0 in 0.559s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:37 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691
Apr 15 23:24:37 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:37 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385
Apr 15 23:24:37 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:37 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-06d221b7-7b07-4152-aab5-91227b180691" returned: 0 in 0.415s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-06d221b7-7b07-4152-aab5-91227b180691" released by "delete_volume" :: held 1.009s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Created reservations ['1fe8ec25-adb5-4664-a2b4-3b165a7160a7', 'f6f1b3da-ec1f-4192-92c2-2766e9410a31', 'b4ba77a6-cb10-47d0-8c64-0a68b123a8d6', 'eeb3da53-1290-44da-97d3-2a6025966406'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:37 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:37 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385" returned: 0 in 0.575s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:37 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:37 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385
Apr 15 23:24:37 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-83b33567-0d3a-4336-a104-b47f82ee5af5-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-83b33567-0d3a-4336-a104-b47f82ee5af5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "cinder-quobyte-83b33567-0d3a-4336-a104-b47f82ee5af5" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-83b33567-0d3a-4336-a104-b47f82ee5af5" acquired by "delete_volume" :: waited 0.020s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5d7931-45df-4f6d-b7ca-895d3ce8fecf]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:37 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5
Apr 15 23:24:37 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:38 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.529s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Deleted volume successfully.
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d26160af-9662-46b7-8970-942bb57c9182 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-06d221b7-7b07-4152-aab5-91227b180691-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:38 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-eb19835d-e66c-41dd-a68b-2ac7f5e54385" returned: 0 in 0.531s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-quobyte-eb19835d-e66c-41dd-a68b-2ac7f5e54385" released by "delete_volume" :: held 1.127s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Created reservations ['233969d8-220e-4710-b55a-56dd998c6055', 'ebaad89a-5bf4-45d2-8797-f264821efb3f', 'bbc6b23e-4b95-46dc-8356-ba25459d7d4d', '59d540cb-36ce-4bb1-bbfd-562714d69335'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:38 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:38 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:38 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5" returned: 0 in 0.537s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:38 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5
Apr 15 23:24:38 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:38 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:38 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Deleted volume successfully.
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-83b33567-0d3a-4336-a104-b47f82ee5af5" returned: 0 in 0.407s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-quobyte-83b33567-0d3a-4336-a104-b47f82ee5af5" released by "delete_volume" :: held 0.968s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e0566f66-910e-4f4b-adc2-ac76e3e894d2 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-eb19835d-e66c-41dd-a68b-2ac7f5e54385-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Created reservations ['9227c782-6672-4245-b5ff-ef3d7034c22b', 'f76b2433-e777-46eb-9b23-f5f71ffee934', '438c9a32-9333-4dad-9c2e-cebaa4d5d228', '830b7bcc-4600-496b-a0fb-ad494d669895'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:38 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:38 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:39 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.433s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:39 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:39 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Deleted volume successfully.
Apr 15 23:24:39 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-836e45b3-de6d-447e-a7a2-62a36c0fde99 tempest-VolumeDependencyTests-1911795851 None] Lock "cinder-83b33567-0d3a-4336-a104-b47f82ee5af5-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (09e2ee55-1942-4ad2-bd20-e0402ff27a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefe7ede-1445-42f3-99a5-256dfb0be4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefe7ede-1445-42f3-99a5-256dfb0be4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791058753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93b5682-e6de-4f82-b749-8a1e6ea8060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:48Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62b4f98-bdf1-4b19-81a0-d2b9b1aec334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62b4f98-bdf1-4b19-81a0-d2b9b1aec334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3807e4-b8f1-40d9-9fee-0e6e3a62b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3807e4-b8f1-40d9-9fee-0e6e3a62b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93b5682-e6de-4f82-b749-8a1e6ea8060e', 'volume_name': 'volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675ef808-381d-4952-bbb8-e729a101778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675ef808-381d-4952-bbb8-e729a101778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4b6c47-4085-468c-b35f-6e353f196ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:47 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Volume e93b5682-e6de-4f82-b749-8a1e6ea8060e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e', 'volume_size': 1}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791058753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93b5682-e6de-4f82-b749-8a1e6ea8060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:48Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Creating volume e93b5682-e6de-4f82-b749-8a1e6ea8060e {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:24:47 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:24:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:47 devstack sudo[88860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e 1073741824
Apr 15 23:24:47 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:48 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e 1073741824" returned: 0 in 0.473s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:48 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e
Apr 15 23:24:48 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:48 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e" returned: 0 in 0.404s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4b6c47-4085-468c-b35f-6e353f196ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20470d1e-7050-467d-ae1f-ce6e26c022b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:48 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Volume volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e (e93b5682-e6de-4f82-b749-8a1e6ea8060e): created successfully
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20470d1e-7050-467d-ae1f-ce6e26c022b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (09e2ee55-1942-4ad2-bd20-e0402ff27a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:48 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-368fd729-727c-41e7-a54e-224df0deffa0 tempest-VolumesActionsTest-1659682262 None] Created volume successfully.
Apr 15 23:24:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-e93b5682-e6de-4f82-b749-8a1e6ea8060e-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-e93b5682-e6de-4f82-b749-8a1e6ea8060e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-quobyte-e93b5682-e6de-4f82-b749-8a1e6ea8060e" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-quobyte-e93b5682-e6de-4f82-b749-8a1e6ea8060e" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d838a79a-b469-4e54-99a3-82bd638f15a5]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:50 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e
Apr 15 23:24:50 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:50 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e" returned: 0 in 0.490s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:50 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e
Apr 15 23:24:50 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:50 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e93b5682-e6de-4f82-b749-8a1e6ea8060e" returned: 0 in 0.410s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-quobyte-e93b5682-e6de-4f82-b749-8a1e6ea8060e" released by "delete_volume" :: held 0.928s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:50 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Created reservations ['2243bbb0-90ff-4a58-9128-9040e7ee98d9', 'fcf2eabe-301b-4198-80e5-f6d61b690d59', '74bbd36a-96da-42d3-9d28-2c423d4859d4', 'b0ff2426-f7ee-4192-ac06-f16c6f086751'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:51 devstack sudo[88876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:51 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (db05f12d-4d55-42aa-83c6-f044572bc209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58c2f2e-2cf1-48fe-8cfa-9a1f9f7a9ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58c2f2e-2cf1-48fe-8cfa-9a1f9f7a9ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31727716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2cc520-d1f9-4264-a938-2bcb8d5e26a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:51Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6f7a27-89b0-403f-9058-72704873b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6f7a27-89b0-403f-9058-72704873b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fe83e9-107f-4383-92d5-c2532e8f1c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fe83e9-107f-4383-92d5-c2532e8f1c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2cc520-d1f9-4264-a938-2bcb8d5e26a5', 'volume_name': 'volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9172202f-1767-42ea-b247-9b625ed51a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9172202f-1767-42ea-b247-9b625ed51a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180a7fa3-3adc-47d7-8f21-ed35e402d477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:51 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Volume 9e2cc520-d1f9-4264-a938-2bcb8d5e26a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5', 'volume_size': 1}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31727716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2cc520-d1f9-4264-a938-2bcb8d5e26a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:51Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Creating volume 9e2cc520-d1f9-4264-a938-2bcb8d5e26a5 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:24:51 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:51 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.410s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Deleted volume successfully.
Apr 15 23:24:51 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5 1073741824
Apr 15 23:24:51 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-82b5c98e-ef86-4be0-969d-ee8d1fd5f0c8 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-e93b5682-e6de-4f82-b749-8a1e6ea8060e-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:51 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5 1073741824" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:51 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5
Apr 15 23:24:51 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:52 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5" returned: 0 in 0.423s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:24:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180a7fa3-3adc-47d7-8f21-ed35e402d477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c38cf-784a-4e0a-83f7-ec4d9607b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:52 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Volume volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5 (9e2cc520-d1f9-4264-a938-2bcb8d5e26a5): created successfully
Apr 15 23:24:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c38cf-784a-4e0a-83f7-ec4d9607b90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (db05f12d-4d55-42aa-83c6-f044572bc209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:52 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-23d74f0f-d548-4726-be06-bb168428a92f tempest-VolumesActionsTest-1659682262 None] Created volume successfully.
Apr 15 23:24:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Lock "cinder-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-quobyte-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Lock "cinder-quobyte-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5" acquired by "delete_volume" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[37872158-84b1-4de2-a288-78ae764e1bf1]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:53 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5
Apr 15 23:24:53 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:54 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5" returned: 0 in 0.512s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:54 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5
Apr 15 23:24:54 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:54 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5" returned: 0 in 0.392s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Lock "cinder-quobyte-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5" released by "delete_volume" :: held 0.926s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Created reservations ['5390e687-e6d5-4603-a6eb-aef63a0d3397', '4bc24cf2-f7bb-42aa-8b7e-401d42621c36', '78b5eb39-d0f0-4183-892c-5f03f437c002', '70dad7ff-79c8-4043-acbc-306215f09832'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:54 devstack sudo[88895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:54 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (c58383d2-d8cd-4f61-8f8d-07dc452cf2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3059d6-d7ac-4cbe-857c-f72626110a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3059d6-d7ac-4cbe-857c-f72626110a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1907218884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a598a13-2bfd-4f30-af22-68e826ed6963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:55Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc46ede-e87b-447c-83f5-837bdb70678e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc46ede-e87b-447c-83f5-837bdb70678e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1486a9-99f9-478f-b869-bb36291d57b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1486a9-99f9-478f-b869-bb36291d57b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a598a13-2bfd-4f30-af22-68e826ed6963', 'volume_name': 'volume-2a598a13-2bfd-4f30-af22-68e826ed6963', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52396ee4-256d-45e8-9745-60a8cd6ef61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52396ee4-256d-45e8-9745-60a8cd6ef61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8882c3fd-4d91-497f-bdaf-0eee026b163c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:54 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Volume 2a598a13-2bfd-4f30-af22-68e826ed6963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a598a13-2bfd-4f30-af22-68e826ed6963', 'volume_size': 1}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1907218884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a598a13-2bfd-4f30-af22-68e826ed6963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:55Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Creating volume 2a598a13-2bfd-4f30-af22-68e826ed6963 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:24:55 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:55 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.432s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Deleted volume successfully.
Apr 15 23:24:55 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963 1073741824
Apr 15 23:24:55 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-70b4d92e-c759-44aa-97a5-1b0a570b905c tempest-VolumesActionsTest-1230453639 None] Lock "cinder-9e2cc520-d1f9-4264-a938-2bcb8d5e26a5-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:55 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963 1073741824" returned: 0 in 0.511s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:55 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963
Apr 15 23:24:55 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:55 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963" returned: 0 in 0.417s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8882c3fd-4d91-497f-bdaf-0eee026b163c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a598a13-2bfd-4f30-af22-68e826ed6963', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dd7b05-259b-475d-9f21-474397b2af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:55 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Volume volume-2a598a13-2bfd-4f30-af22-68e826ed6963 (2a598a13-2bfd-4f30-af22-68e826ed6963): created successfully
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dd7b05-259b-475d-9f21-474397b2af79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:55 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (c58383d2-d8cd-4f61-8f8d-07dc452cf2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:55 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-dbff819f-62ff-49d8-bfe1-56af15f88319 tempest-VolumesActionsTest-1659682262 None] Created volume successfully.
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-2a598a13-2bfd-4f30-af22-68e826ed6963-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-2a598a13-2bfd-4f30-af22-68e826ed6963-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-quobyte-2a598a13-2bfd-4f30-af22-68e826ed6963" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-quobyte-2a598a13-2bfd-4f30-af22-68e826ed6963" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b81e7-1eac-4dcf-8d08-b37d7a95f257]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:57 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:57 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:57 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963
Apr 15 23:24:57 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:57 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.389s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:57 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963" returned: 0 in 0.461s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:57 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963
Apr 15 23:24:57 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:58 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2a598a13-2bfd-4f30-af22-68e826ed6963" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-quobyte-2a598a13-2bfd-4f30-af22-68e826ed6963" released by "delete_volume" :: held 0.903s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Created reservations ['17b5eca0-9daa-43cb-8c64-61360bb56d67', '894cb4cb-3283-4f28-9647-4add9f76d2c7', 'df091d95-5b7c-4809-bb01-ee9d083c560b', '3db0f860-c362-4302-bf90-c79d91733b94'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:58 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:24:58 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (ebfb0ec7-94ba-4623-b0a8-52e9e90f0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1d9de0-2b8a-4f0c-ba23-9872ee269f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1d9de0-2b8a-4f0c-ba23-9872ee269f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23419637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15feaca2-9f7d-4a68-b2c0-daf2ff214da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:58Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51050a7-06e5-40af-b5c9-ab004158441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51050a7-06e5-40af-b5c9-ab004158441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4b99a7-bb6a-46e3-8ea4-0a657b1e6f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4b99a7-bb6a-46e3-8ea4-0a657b1e6f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15feaca2-9f7d-4a68-b2c0-daf2ff214da0', 'volume_name': 'volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c1b4f0-9b7e-4d53-9286-fcb83a95a9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c1b4f0-9b7e-4d53-9286-fcb83a95a9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e5cb55-e6a2-42c7-9235-d898e35731e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:58 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Volume 15feaca2-9f7d-4a68-b2c0-daf2ff214da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0', 'volume_size': 1}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23419637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15feaca2-9f7d-4a68-b2c0-daf2ff214da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:58Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Creating volume 15feaca2-9f7d-4a68-b2c0-daf2ff214da0 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:24:58 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:24:58 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.444s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:24:58 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Deleted volume successfully.
Apr 15 23:24:58 devstack sudo[88921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0 1073741824
Apr 15 23:24:58 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-80190d56-f5e7-4e05-9caa-65746ed5df57 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-2a598a13-2bfd-4f30-af22-68e826ed6963-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:24:59 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0 1073741824" returned: 0 in 0.486s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:24:59 devstack sudo[88926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0
Apr 15 23:24:59 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:24:59 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0" returned: 0 in 0.398s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e5cb55-e6a2-42c7-9235-d898e35731e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40706214-5584-4f4f-bd14-b790ad49447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:24:59 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Volume volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0 (15feaca2-9f7d-4a68-b2c0-daf2ff214da0): created successfully
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40706214-5584-4f4f-bd14-b790ad49447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:24:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (ebfb0ec7-94ba-4623-b0a8-52e9e90f0075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:24:59 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f071e02f-077b-4084-b61a-2910452dce7b tempest-VolumesActionsTest-1659682262 None] Created volume successfully.
Apr 15 23:25:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-15feaca2-9f7d-4a68-b2c0-daf2ff214da0-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-15feaca2-9f7d-4a68-b2c0-daf2ff214da0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "cinder-quobyte-15feaca2-9f7d-4a68-b2c0-daf2ff214da0" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-quobyte-15feaca2-9f7d-4a68-b2c0-daf2ff214da0" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:00 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5048e4-eb81-42fa-8e6d-aef395615f18]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:00 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0
Apr 15 23:25:00 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:01 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:01 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0
Apr 15 23:25:01 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:01 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-15feaca2-9f7d-4a68-b2c0-daf2ff214da0" returned: 0 in 0.402s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-quobyte-15feaca2-9f7d-4a68-b2c0-daf2ff214da0" released by "delete_volume" :: held 0.905s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Created reservations ['e455d2d9-cfe2-4010-a9f2-d944e40b1186', 'de5a82ff-b923-4b38-8268-25589c78acd4', 'fedcc46b-cd34-489d-b4b0-91a57acdf3b5', 'fb7a16f2-d7e9-4405-8e1a-7cf7be597f10'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:01 devstack sudo[88937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:25:01 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (fe1ce525-42af-4e38-a036-332ccd848806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16136305-8f3d-4b2c-95ca-b7f20982b433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16136305-8f3d-4b2c-95ca-b7f20982b433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1506662730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bea88c-ea7a-4afb-9192-56454837c1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:02Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e146d4-9602-483b-b543-035583e3c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e146d4-9602-483b-b543-035583e3c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891060f7-239c-4b32-8365-ca462f5450d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891060f7-239c-4b32-8365-ca462f5450d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7bea88c-ea7a-4afb-9192-56454837c1e3', 'volume_name': 'volume-b7bea88c-ea7a-4afb-9192-56454837c1e3', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8689802-9f38-41d2-81eb-e56157d7a667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8689802-9f38-41d2-81eb-e56157d7a667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05726e8f-9215-4767-8bca-7b28eb5b1b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:02 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Volume b7bea88c-ea7a-4afb-9192-56454837c1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7bea88c-ea7a-4afb-9192-56454837c1e3', 'volume_size': 1}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1506662730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bea88c-ea7a-4afb-9192-56454837c1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e204e90e34042309fde153eec799078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:02Z,use_quota=True,user_id='57001ac9d14744e2a0cbcff5a2b07974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Creating volume b7bea88c-ea7a-4afb-9192-56454837c1e3 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:25:02 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:02 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.442s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:25:02 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Deleted volume successfully.
Apr 15 23:25:02 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3 1073741824
Apr 15 23:25:02 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cd4569ed-d113-4897-abcb-f1a262df8fc9 tempest-VolumesActionsTest-1230453639 None] Lock "cinder-15feaca2-9f7d-4a68-b2c0-daf2ff214da0-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:02 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3 1073741824" returned: 0 in 0.477s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:02 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3
Apr 15 23:25:02 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:03 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3" returned: 0 in 0.397s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05726e8f-9215-4767-8bca-7b28eb5b1b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bea88c-ea7a-4afb-9192-56454837c1e3', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05758a25-ff65-4ed1-a676-590c15955d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:03 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Volume volume-b7bea88c-ea7a-4afb-9192-56454837c1e3 (b7bea88c-ea7a-4afb-9192-56454837c1e3): created successfully
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05758a25-ff65-4ed1-a676-590c15955d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Flow 'volume_create_manager' (fe1ce525-42af-4e38-a036-332ccd848806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-eebd34be-0cf7-4542-8fa2-324e1fd47eff tempest-VolumesActionsTest-1659682262 None] Created volume successfully.
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "cinder-b7bea88c-ea7a-4afb-9192-56454837c1e3-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-b7bea88c-ea7a-4afb-9192-56454837c1e3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "cinder-quobyte-b7bea88c-ea7a-4afb-9192-56454837c1e3" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-quobyte-b7bea88c-ea7a-4afb-9192-56454837c1e3" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8901a05e-b69c-42eb-867b-5cf112c2a824]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:03 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3
Apr 15 23:25:03 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:04 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:04 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3
Apr 15 23:25:04 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:04 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b7bea88c-ea7a-4afb-9192-56454837c1e3" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-quobyte-b7bea88c-ea7a-4afb-9192-56454837c1e3" released by "delete_volume" :: held 0.899s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Created reservations ['96b5f1cc-16c8-491f-be4e-cd3a5e9c7b50', 'b636cfef-d8e9-4d44-9f03-d55aeaed4f3d', 'f81c9950-e019-4c42-8308-9b4a97c61c3f', '1bf6411e-4407-4173-9cb9-a37091187bb7'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:04 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:25:04 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:05 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.473s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:05 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:25:05 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Deleted volume successfully.
Apr 15 23:25:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-5136aed9-c185-4f7f-8936-a99f2c0a8360 tempest-VolumesActionsTest-1659682262 None] Lock "cinder-b7bea88c-ea7a-4afb-9192-56454837c1e3-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Flow 'volume_create_manager' (350e7003-da2b-480b-9ef2-df9a847780a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7b6804-9316-4e0a-ba67-d90dca0a12a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7b6804-9316-4e0a-ba67-d90dca0a12a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1655910739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9078199-b5b3-411d-a065-7a0a352f9017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0acb56daf948a28e9a530f83b1ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:12Z,use_quota=True,user_id='4bc3337a5c8b4412a1018d7c2f4df667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e15db61-e52c-42a4-96e3-bfc143d5afbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e15db61-e52c-42a4-96e3-bfc143d5afbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdff3e3-2e42-4695-aaa5-115219aba9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdff3e3-2e42-4695-aaa5-115219aba9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9078199-b5b3-411d-a065-7a0a352f9017', 'volume_name': 'volume-d9078199-b5b3-411d-a065-7a0a352f9017', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70d10d9-6863-44b4-8db5-b5fc09f665b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70d10d9-6863-44b4-8db5-b5fc09f665b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d49241-fd63-4728-9001-613159cbcb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:11 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Volume d9078199-b5b3-411d-a065-7a0a352f9017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9078199-b5b3-411d-a065-7a0a352f9017', 'volume_size': 1}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1655910739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9078199-b5b3-411d-a065-7a0a352f9017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0acb56daf948a28e9a530f83b1ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:12Z,use_quota=True,user_id='4bc3337a5c8b4412a1018d7c2f4df667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Creating volume d9078199-b5b3-411d-a065-7a0a352f9017 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:25:11 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:25:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:11 devstack sudo[89109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017 1073741824
Apr 15 23:25:11 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:12 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017 1073741824" returned: 0 in 0.471s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:12 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017
Apr 15 23:25:12 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:12 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017" returned: 0 in 0.416s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d49241-fd63-4728-9001-613159cbcb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9078199-b5b3-411d-a065-7a0a352f9017', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b4c5f8-493b-4449-b5b5-b69629f59a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:12 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Volume volume-d9078199-b5b3-411d-a065-7a0a352f9017 (d9078199-b5b3-411d-a065-7a0a352f9017): created successfully
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b4c5f8-493b-4449-b5b5-b69629f59a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:12 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Flow 'volume_create_manager' (350e7003-da2b-480b-9ef2-df9a847780a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:12 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8fc9c0e4-5821-41f6-81a7-3f89a62aa3b1 tempest-AbsoluteLimitsTests-1008387164 None] Created volume successfully.
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Acquiring lock "cinder-d9078199-b5b3-411d-a065-7a0a352f9017-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Lock "cinder-d9078199-b5b3-411d-a065-7a0a352f9017-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Acquiring lock "cinder-quobyte-d9078199-b5b3-411d-a065-7a0a352f9017" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Lock "cinder-quobyte-d9078199-b5b3-411d-a065-7a0a352f9017" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61567eb-d801-4809-89e0-5145fc9aa2a8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:14 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017
Apr 15 23:25:14 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:14 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017" returned: 0 in 0.469s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:14 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017
Apr 15 23:25:14 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:14 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d9078199-b5b3-411d-a065-7a0a352f9017" returned: 0 in 0.429s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Lock "cinder-quobyte-d9078199-b5b3-411d-a065-7a0a352f9017" released by "delete_volume" :: held 0.925s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Created reservations ['f5d7a070-0915-4250-bfcd-b75dca7165fe', '02171a89-8117-4f16-8148-6f2e6e887bd0', 'a828715f-3fc6-4306-81d9-fec695c70a14', '4d9f534b-c318-4a8f-a705-14b77d834009'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:15 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:25:15 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:15 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.428s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:25:15 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Deleted volume successfully.
Apr 15 23:25:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-83eb2eee-a654-4323-b518-ea3d4c8e6961 tempest-AbsoluteLimitsTests-1008387164 None] Lock "cinder-d9078199-b5b3-411d-a065-7a0a352f9017-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Flow 'volume_create_manager' (41591fee-cfb6-4672-8b32-ce286043a6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0561d0-047d-4f0d-acb3-0741835216c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0561d0-047d-4f0d-acb3-0741835216c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2081072865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8443a15-a51a-4261-be4c-76f99d7321d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fa4ec82d2d4998aefb4b4af7ac72ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:18Z,use_quota=True,user_id='0c2a7f67ba6142229438ddcae3a78eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1488e164-d383-49df-89e6-16ca9b0201db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1488e164-d383-49df-89e6-16ca9b0201db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b5e8fe-1073-4ab5-b258-1a4c026f3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.image.glance [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Creating Keystone auth plugin from conf {{(pid=81941) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b5e8fe-1073-4ab5-b258-1a4c026f3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8443a15-a51a-4261-be4c-76f99d7321d1', 'volume_name': 'volume-b8443a15-a51a-4261-be4c-76f99d7321d1', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f11556edde0>}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86de352-9053-4947-ab07-6f4faa5c50b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86de352-9053-4947-ab07-6f4faa5c50b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5643d881-3c14-4b64-81d5-ee0c20382d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Volume b8443a15-a51a-4261-be4c-76f99d7321d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8443a15-a51a-4261-be4c-76f99d7321d1', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f11556edde0>}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Trying to clone b8443a15-a51a-4261-be4c-76f99d7321d1 from image 0e2861bb-d33e-45a3-86bc-d3d94070676e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]). {{(pid=81941) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 23:25:17 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c3241f-0fca-4dfc-9fe3-a975ab8ed284]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:18 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD
Apr 15 23:25:18 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:18 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Temporary image 0e2861bb-d33e-45a3-86bc-d3d94070676e is fetched for user 0c2a7f67ba6142229438ddcae3a78eac. {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fa2c79-4d2f-4441-8309-1e754015174d]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:18 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD
Apr 15 23:25:18 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:18 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2081072865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8443a15-a51a-4261-be4c-76f99d7321d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fa4ec82d2d4998aefb4b4af7ac72ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:18Z,use_quota=True,user_id='0c2a7f67ba6142229438ddcae3a78eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Creating volume b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:25:18 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:25:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:18 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 1073741824
Apr 15 23:25:18 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:19 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 1073741824" returned: 0 in 0.450s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:19 devstack sudo[89233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:19 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:19 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 0 in 0.430s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:25:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:19 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Attempting download of 0e2861bb-d33e-45a3-86bc-d3d94070676e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}])) to volume b8443a15-a51a-4261-be4c-76f99d7321d1. {{(pid=81941) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 23:25:19 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c918ae4-d350-495d-ba14-eca9a9c7b37d]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_5xd307a9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:19 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_5xd307a9
Apr 15 23:25:19 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:20 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_5xd307a9" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_5xd307a9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:20 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_5xd307a9
Apr 15 23:25:20 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:20 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_5xd307a9" returned: 1 in 0.449s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e2861bb-d33e-45a3-86bc-d3d94070676e_5xd307a9' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:25:20 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08dbefd-7482-48fd-9b90-bbf57165f622]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:20 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD
Apr 15 23:25:20 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:21 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:21 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] 0e2861bb-d33e-45a3-86bc-d3d94070676e was qcow2, converting to raw {{(pid=81941) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 23:25:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:21 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:21 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:22 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 0 in 0.790s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:22 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e2861bb-d33e-45a3-86bc-d3d94070676e_l4erl0m4devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:25:22 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Converted 112.00 MB image at 112.00 MB/s
Apr 15 23:25:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:22 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 1G
Apr 15 23:25:22 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:22 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 1G" returned: 0 in 0.410s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:22 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8473548b-2b97-4fea-a949-a8d3b503c3c5]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:22 devstack sudo[89271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:22 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:22 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 0 in 0.464s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:22 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:22 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:23 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 1 in 0.442s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Downloaded image 0e2861bb-d33e-45a3-86bc-d3d94070676e ((None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}])) to volume b8443a15-a51a-4261-be4c-76f99d7321d1 successfully. {{(pid=81941) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Temporary image 0e2861bb-d33e-45a3-86bc-d3d94070676e for user 0c2a7f67ba6142229438ddcae3a78eac is deleted. {{(pid=81941) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.volume.volume_utils [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Marking volume b8443a15-a51a-4261-be4c-76f99d7321d1 as bootable. {{(pid=81941) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Copying metadata from image 0e2861bb-d33e-45a3-86bc-d3d94070676e to b8443a15-a51a-4261-be4c-76f99d7321d1. {{(pid=81941) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Creating volume glance metadata for volume b8443a15-a51a-4261-be4c-76f99d7321d1 backed by image 0e2861bb-d33e-45a3-86bc-d3d94070676e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81941) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5643d881-3c14-4b64-81d5-ee0c20382d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8443a15-a51a-4261-be4c-76f99d7321d1', 'volume_size': 1, 'image_id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e2861bb-d33e-45a3-86bc-d3d94070676e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ac42e36181b4d458f243842e185de40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e2861bb-d33e-45a3-86bc-d3d94070676e', 'created_at': datetime.datetime(2026, 4, 15, 21, 12, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 12, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e2861bb-d33e-45a3-86bc-d3d94070676e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f11556edde0>}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dde01ca-2076-423f-b43a-e4819831fb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:23 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Volume volume-b8443a15-a51a-4261-be4c-76f99d7321d1 (b8443a15-a51a-4261-be4c-76f99d7321d1): created successfully
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dde01ca-2076-423f-b43a-e4819831fb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Flow 'volume_create_manager' (41591fee-cfb6-4672-8b32-ce286043a6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:23 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2437212e-9d1c-4c02-8a86-5b11ca626d4d tempest-VolumesExtendTest-792266274 None] Created volume successfully.
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2a9a8c-3ed8-455a-8d04-38852b2a8175]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:23 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:23 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:24 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:24 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:24 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:24 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 1 in 0.451s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:25:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 2G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 2G" returned: 0 in 0.038s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.967s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:24 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e9a5335e-3c53-463f-9fe8-81b8f076f865 tempest-VolumesExtendTest-792266274 None] Extend volume completed successfully.
Apr 15 23:25:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Acquiring lock "cinder-b8443a15-a51a-4261-be4c-76f99d7321d1-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Lock "cinder-b8443a15-a51a-4261-be4c-76f99d7321d1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Acquiring lock "cinder-quobyte-b8443a15-a51a-4261-be4c-76f99d7321d1" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:25 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Lock "cinder-quobyte-b8443a15-a51a-4261-be4c-76f99d7321d1" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:25 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53e9bc7-5b59-4600-8067-5b4f52dee85a]: (4, 'raw') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:25 devstack sudo[89292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:25 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:25 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 0 in 0.438s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:25 devstack sudo[89297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:25 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:26 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 1 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1' failed. Not Retrying. {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:26 devstack sudo[89302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1
Apr 15 23:25:26 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:26 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b8443a15-a51a-4261-be4c-76f99d7321d1" returned: 0 in 0.392s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Lock "cinder-quobyte-b8443a15-a51a-4261-be4c-76f99d7321d1" released by "delete_volume" :: held 1.325s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Created reservations ['629a9c77-90fa-45e8-9ab1-16ea40670b6e', '4a3b158b-9716-4a2e-9824-b74f459ff916', 'f13c7d13-c3b9-474b-96bc-b1f9d806e92d', 'c7f9a549-5a2e-4a51-a715-b1c94d4c2641'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:26 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:25:26 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:26 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.385s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:25:26 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Deleted volume successfully.
Apr 15 23:25:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02aedd4e-a054-4c28-91e5-8829a79a1d72 tempest-VolumesExtendTest-792266274 None] Lock "cinder-b8443a15-a51a-4261-be4c-76f99d7321d1-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Flow 'volume_create_manager' (e49ed73e-6f6a-4667-8dd5-2b07da13131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5319ef3-cc15-44b7-ab6a-18d50be2325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5319ef3-cc15-44b7-ab6a-18d50be2325e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-913534757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7788dab-f390-40c8-b4a3-128148e4edf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fa4ec82d2d4998aefb4b4af7ac72ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:27Z,use_quota=True,user_id='0c2a7f67ba6142229438ddcae3a78eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b73a5f0-eda6-4eed-8a06-3aa72433faf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b73a5f0-eda6-4eed-8a06-3aa72433faf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb0b4d2-7b46-4ef9-87fd-5561e663c685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb0b4d2-7b46-4ef9-87fd-5561e663c685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7788dab-f390-40c8-b4a3-128148e4edf8', 'volume_name': 'volume-f7788dab-f390-40c8-b4a3-128148e4edf8', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befb0152-4d17-4738-a341-f8a6093e5259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befb0152-4d17-4738-a341-f8a6093e5259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d399d35a-cc73-43b4-a977-ae6e63c1bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:27 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Volume f7788dab-f390-40c8-b4a3-128148e4edf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7788dab-f390-40c8-b4a3-128148e4edf8', 'volume_size': 1}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-913534757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7788dab-f390-40c8-b4a3-128148e4edf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fa4ec82d2d4998aefb4b4af7ac72ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:27Z,use_quota=True,user_id='0c2a7f67ba6142229438ddcae3a78eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Creating volume f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:25:27 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:27 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 1073741824
Apr 15 23:25:27 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:27 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 1073741824" returned: 0 in 0.484s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:28 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8
Apr 15 23:25:28 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:28 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8" returned: 0 in 0.383s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d399d35a-cc73-43b4-a977-ae6e63c1bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7788dab-f390-40c8-b4a3-128148e4edf8', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134b752b-22b7-44bc-9303-a3fa05da6fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:28 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Volume volume-f7788dab-f390-40c8-b4a3-128148e4edf8 (f7788dab-f390-40c8-b4a3-128148e4edf8): created successfully
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134b752b-22b7-44bc-9303-a3fa05da6fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Flow 'volume_create_manager' (e49ed73e-6f6a-4667-8dd5-2b07da13131b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-789d78d0-5961-44c4-ada1-aa9422c08b51 tempest-VolumesExtendTest-792266274 None] Created volume successfully.
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Creating offline snapshot 95eeceda-aaec-43d6-810a-f0a4c2959358 of volume f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4a2a98-0596-461f-9ed8-3a160c2dd364]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:28 devstack sudo[89316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8
Apr 15 23:25:28 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:29 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:29 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 1G
Apr 15 23:25:29 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:29 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 1G" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7788dab-f390-40c8-b4a3-128148e4edf8 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:29 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7788dab-f390-40c8-b4a3-128148e4edf8 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358
Apr 15 23:25:29 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:29 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7788dab-f390-40c8-b4a3-128148e4edf8 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358" returned: 0 in 0.417s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:29 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 is being set with open permissions: ugo+rw
Apr 15 23:25:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:29 devstack sudo[89331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358
Apr 15 23:25:29 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:30 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358" returned: 0 in 0.388s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:30 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.info
Apr 15 23:25:30 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:30 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.info" returned: 0 in 0.395s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:30 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.info is being set with open permissions: ugo+rw
Apr 15 23:25:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:30 devstack sudo[89337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.info
Apr 15 23:25:30 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:31 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.info" returned: 0 in 0.394s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:31 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f76c936e-7b4c-4c1f-be42-dc81c87eb876 tempest-VolumesExtendTest-792266274 None] Create snapshot completed successfully
Apr 15 23:25:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78841107-04b3-489f-96ee-ad7e89c4443f tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78841107-04b3-489f-96ee-ad7e89c4443f tempest-VolumesExtendTest-792266274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:31 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e03f9c-d47f-430a-85a7-ea53a0f9ab24]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78841107-04b3-489f-96ee-ad7e89c4443f tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:31 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8
Apr 15 23:25:31 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:32 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78841107-04b3-489f-96ee-ad7e89c4443f tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78841107-04b3-489f-96ee-ad7e89c4443f tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 2G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78841107-04b3-489f-96ee-ad7e89c4443f tempest-VolumesExtendTest-792266274 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 2G" returned: 0 in 0.065s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78841107-04b3-489f-96ee-ad7e89c4443f tempest-VolumesExtendTest-792266274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.534s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=99,cinder:UPDATE=115,cinder:DELETE=12,cinder:INSERT=37 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:25:32 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-78841107-04b3-489f-96ee-ad7e89c4443f tempest-VolumesExtendTest-792266274 None] Extend volume completed successfully.
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Acquiring lock "cinder-95eeceda-aaec-43d6-810a-f0a4c2959358-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Lock "cinder-95eeceda-aaec-43d6-810a-f0a4c2959358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Acquiring lock "cinder-quobyte-f7788dab-f390-40c8-b4a3-128148e4edf8" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Lock "cinder-quobyte-f7788dab-f390-40c8-b4a3-128148e4edf8" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Acquiring lock "cinder-quobyte-95eeceda-aaec-43d6-810a-f0a4c2959358" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Lock "cinder-quobyte-95eeceda-aaec-43d6-810a-f0a4c2959358" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Deleting offline snapshot 95eeceda-aaec-43d6-810a-f0a4c2959358 of volume f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] snapshot_file for this snap is: volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41f1550-93ef-4bae-8b0e-4fcae3243d25]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:33 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358
Apr 15 23:25:33 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:33 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358" returned: 0 in 0.458s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7788dab-f390-40c8-b4a3-128148e4edf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[992c235d-97a4-456f-8def-c559ea41ef29]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:33 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8
Apr 15 23:25:33 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:33 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8" returned: 0 in 0.451s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:33 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358
Apr 15 23:25:33 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:34 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358" returned: 0 in 0.439s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:34 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358
Apr 15 23:25:34 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:34 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8.95eeceda-aaec-43d6-810a-f0a4c2959358" returned: 0 in 0.412s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Lock "cinder-quobyte-95eeceda-aaec-43d6-810a-f0a4c2959358" released by "_delete_snapshot" :: held 1.807s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Lock "cinder-quobyte-f7788dab-f390-40c8-b4a3-128148e4edf8" released by "delete_snapshot" :: held 1.820s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:34 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Created reservations ['6d718579-b88b-4ffe-a235-393ce3f4202b', '0748697c-c91b-47b5-aa75-a7e029c11a25', '78858863-4ec4-420a-902f-6717bf4c91c3', '6b1cbabe-a89e-49a4-b357-f1d2eb38f0b1'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:25:34 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Delete snapshot completed successfully.
Apr 15 23:25:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-aa4fb283-0ac8-401b-8a6f-929b3fc618ea tempest-VolumesExtendTest-792266274 None] Lock "cinder-95eeceda-aaec-43d6-810a-f0a4c2959358-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Acquiring lock "cinder-f7788dab-f390-40c8-b4a3-128148e4edf8-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Lock "cinder-f7788dab-f390-40c8-b4a3-128148e4edf8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Acquiring lock "cinder-quobyte-f7788dab-f390-40c8-b4a3-128148e4edf8" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:25:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Lock "cinder-quobyte-f7788dab-f390-40c8-b4a3-128148e4edf8" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:25:35 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb033a1-7df3-47d1-9e56-d15db7184a48]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:25:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:35 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8
Apr 15 23:25:35 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:35 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:35 devstack sudo[89378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8
Apr 15 23:25:35 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:36 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7788dab-f390-40c8-b4a3-128148e4edf8" returned: 0 in 0.390s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Lock "cinder-quobyte-f7788dab-f390-40c8-b4a3-128148e4edf8" released by "delete_volume" :: held 0.873s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Created reservations ['9b45dfc5-474f-477d-936c-03b5a3c43b25', '7201e2de-87ff-47dd-b6e7-2bb8ce575568', 'cab25064-68f9-4fd0-b8bf-5e00f89d4af1', 'cc7386a8-8740-4ade-a4c8-1e02ed0136d6'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:36 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:25:36 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:36 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.443s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:25:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Deleted volume successfully.
Apr 15 23:25:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-062adb38-1fb5-413a-b165-72b53d87c0df tempest-VolumesExtendTest-792266274 None] Lock "cinder-f7788dab-f390-40c8-b4a3-128148e4edf8-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=90,cinder:INSERT=33,cinder:UPDATE=140,cinder:DELETE=10 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Flow 'volume_create_manager' (c7504e2e-1169-42e5-97c0-1d2628c983e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26006246-1f45-46a1-b00a-644098f313dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26006246-1f45-46a1-b00a-644098f313dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1671599778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709624bf-2fca-4de9-90c0-1464b17d4506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0945d703d83a4f888dc2cb0106a2b0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:38Z,use_quota=True,user_id='59510684deb949bd93881c4e0b8b4660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edf0854-fad9-4a85-9815-a23e4e8c9ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edf0854-fad9-4a85-9815-a23e4e8c9ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04ae1e7-1c12-45bd-a357-52afb9d34c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04ae1e7-1c12-45bd-a357-52afb9d34c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709624bf-2fca-4de9-90c0-1464b17d4506', 'volume_name': 'volume-709624bf-2fca-4de9-90c0-1464b17d4506', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f11a903-e442-4408-97d8-e59028ad8c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f11a903-e442-4408-97d8-e59028ad8c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964e3103-d5b0-47dd-8880-96fffda2661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:37 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Volume 709624bf-2fca-4de9-90c0-1464b17d4506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709624bf-2fca-4de9-90c0-1464b17d4506', 'volume_size': 1}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1671599778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709624bf-2fca-4de9-90c0-1464b17d4506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0945d703d83a4f888dc2cb0106a2b0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:38Z,use_quota=True,user_id='59510684deb949bd93881c4e0b8b4660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Creating volume 709624bf-2fca-4de9-90c0-1464b17d4506 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:25:37 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:25:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:37 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506 1073741824
Apr 15 23:25:37 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:38 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506 1073741824" returned: 0 in 0.460s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:38 devstack sudo[89389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506
Apr 15 23:25:38 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:38 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506" returned: 0 in 0.395s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964e3103-d5b0-47dd-8880-96fffda2661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709624bf-2fca-4de9-90c0-1464b17d4506', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8026a834-4b26-4704-9f04-67736eb4ee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:25:38 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Volume volume-709624bf-2fca-4de9-90c0-1464b17d4506 (709624bf-2fca-4de9-90c0-1464b17d4506): created successfully
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8026a834-4b26-4704-9f04-67736eb4ee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:25:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Flow 'volume_create_manager' (c7504e2e-1169-42e5-97c0-1d2628c983e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:25:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ece601f9-b17c-47c9-822c-5e2170252c49 tempest-VolumesNegativeTest-1444576532 None] Created volume successfully.
Apr 15 23:25:48 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:25:48 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:25:57 devstack sudo[89508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:25:57 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:25:57 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.405s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:25:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:26:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Acquiring lock "cinder-709624bf-2fca-4de9-90c0-1464b17d4506-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Lock "cinder-709624bf-2fca-4de9-90c0-1464b17d4506-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Acquiring lock "cinder-quobyte-709624bf-2fca-4de9-90c0-1464b17d4506" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Lock "cinder-quobyte-709624bf-2fca-4de9-90c0-1464b17d4506" acquired by "delete_volume" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:01 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bd5e36-2446-4b6b-9a44-e1ae4b5b9212]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:01 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506
Apr 15 23:26:01 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:01 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506" returned: 0 in 0.457s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:01 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506
Apr 15 23:26:01 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:02 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-709624bf-2fca-4de9-90c0-1464b17d4506" returned: 0 in 0.399s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Lock "cinder-quobyte-709624bf-2fca-4de9-90c0-1464b17d4506" released by "delete_volume" :: held 0.883s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Created reservations ['f4b3fefa-19d3-495a-ae9b-140908cc0503', 'd39055ca-643c-482a-8623-722cc035b48a', 'bb33a881-6915-432b-b48b-268abe7bb1b9', 'b0480655-c767-4266-b4be-28620389c906'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:02 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:26:02 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:02 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.441s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:26:02 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Deleted volume successfully.
Apr 15 23:26:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3c4a00b-75e9-4cfd-8480-c2ece8c79e10 tempest-VolumesNegativeTest-1444576532 None] Lock "cinder-709624bf-2fca-4de9-90c0-1464b17d4506-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (5dcbbab2-6faf-4acd-9468-e1958994c902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b02e8c0-3f0e-405c-9ae3-ed6593200577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b02e8c0-3f0e-405c-9ae3-ed6593200577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1120129414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506f4923-392f-4d3a-84d9-def42b86402c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2e84f5e7347cfbe9e4ca4e0cab522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:11Z,use_quota=True,user_id='eaf317f1f3f04548b9401f1d30ed2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4505bae-3f84-4674-92f3-d179e7c0b8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4505bae-3f84-4674-92f3-d179e7c0b8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12dd000-bf03-43fa-8437-83ca20341b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12dd000-bf03-43fa-8437-83ca20341b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506f4923-392f-4d3a-84d9-def42b86402c', 'volume_name': 'volume-506f4923-392f-4d3a-84d9-def42b86402c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed8cab0-7ca8-44dd-a829-6a28f3b236df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed8cab0-7ca8-44dd-a829-6a28f3b236df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bc381e-99f6-4d1e-97fb-980087e5633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:10 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Volume 506f4923-392f-4d3a-84d9-def42b86402c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506f4923-392f-4d3a-84d9-def42b86402c', 'volume_size': 1}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1120129414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506f4923-392f-4d3a-84d9-def42b86402c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2e84f5e7347cfbe9e4ca4e0cab522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:11Z,use_quota=True,user_id='eaf317f1f3f04548b9401f1d30ed2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Creating volume 506f4923-392f-4d3a-84d9-def42b86402c {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:10 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:26:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:10 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c 1073741824
Apr 15 23:26:10 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:11 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c 1073741824" returned: 0 in 0.468s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:11 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c
Apr 15 23:26:11 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:11 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c" returned: 0 in 0.388s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bc381e-99f6-4d1e-97fb-980087e5633a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506f4923-392f-4d3a-84d9-def42b86402c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08e86aa-bf42-489d-a75a-f0d17453e2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:11 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Volume volume-506f4923-392f-4d3a-84d9-def42b86402c (506f4923-392f-4d3a-84d9-def42b86402c): created successfully
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08e86aa-bf42-489d-a75a-f0d17453e2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:11 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (5dcbbab2-6faf-4acd-9468-e1958994c902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0a06ea75-0c92-49f9-96b1-21dae602c56a tempest-VolumesSnapshotTestJSON-1308288313 None] Created volume successfully.
Apr 15 23:26:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Creating offline snapshot 4022df19-5fbd-4d43-8c0f-cbf9510a9f08 of volume 506f4923-392f-4d3a-84d9-def42b86402c {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:26:12 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c9990-cf9d-47a1-a6fa-f47b182be1d6]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:12 devstack sudo[89534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c
Apr 15 23:26:12 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:13 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:13 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 1G
Apr 15 23:26:13 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:13 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 1G" returned: 0 in 0.457s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-506f4923-392f-4d3a-84d9-def42b86402c -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:13 devstack sudo[89545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-506f4923-392f-4d3a-84d9-def42b86402c -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08
Apr 15 23:26:13 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:14 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-506f4923-392f-4d3a-84d9-def42b86402c -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08" returned: 0 in 0.410s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:14 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 is being set with open permissions: ugo+rw
Apr 15 23:26:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:14 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08
Apr 15 23:26:14 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:14 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08" returned: 0 in 0.387s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:14 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.info
Apr 15 23:26:14 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:15 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.info" returned: 0 in 0.417s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:15 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.info is being set with open permissions: ugo+rw
Apr 15 23:26:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:15 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.info
Apr 15 23:26:15 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:15 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.info" returned: 0 in 0.387s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:15 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-76f604ba-9a2f-4793-aa13-902fe5817644 tempest-VolumesSnapshotTestJSON-1308288313 None] Create snapshot completed successfully
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-4022df19-5fbd-4d43-8c0f-cbf9510a9f08-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-4022df19-5fbd-4d43-8c0f-cbf9510a9f08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-506f4923-392f-4d3a-84d9-def42b86402c" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-506f4923-392f-4d3a-84d9-def42b86402c" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-4022df19-5fbd-4d43-8c0f-cbf9510a9f08" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-4022df19-5fbd-4d43-8c0f-cbf9510a9f08" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Deleting offline snapshot 4022df19-5fbd-4d43-8c0f-cbf9510a9f08 of volume 506f4923-392f-4d3a-84d9-def42b86402c {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] snapshot_file for this snap is: volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a57b6f3-980a-4fb9-94ae-2a385be303ba]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:16 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08
Apr 15 23:26:16 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:16 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-506f4923-392f-4d3a-84d9-def42b86402c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba757d6-af83-40d2-b9eb-721586522928]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:16 devstack sudo[89566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c
Apr 15 23:26:16 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:17 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c" returned: 0 in 0.441s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:17 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08
Apr 15 23:26:17 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:17 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08" returned: 0 in 0.423s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:17 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08
Apr 15 23:26:17 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:17 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c.4022df19-5fbd-4d43-8c0f-cbf9510a9f08" returned: 0 in 0.395s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-4022df19-5fbd-4d43-8c0f-cbf9510a9f08" released by "_delete_snapshot" :: held 1.759s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-506f4923-392f-4d3a-84d9-def42b86402c" released by "delete_snapshot" :: held 1.769s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Created reservations ['5d429f49-6168-46bd-a780-5c63153b780f', 'eb6f99f8-a4fd-4e52-ac9a-dbe2066fd47d', '98d78324-6e9d-406b-acad-098e9250e4a2', '2afd5b21-8ca5-4451-ac95-b1fe7333f115'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:17 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Delete snapshot completed successfully.
Apr 15 23:26:17 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-856294e8-e533-4a9e-9003-7202dfab64ac tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-4022df19-5fbd-4d43-8c0f-cbf9510a9f08-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (e860202c-956b-4ece-97d1-b591e565ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054bb867-e95d-4356-92d0-cd21593b64cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054bb867-e95d-4356-92d0-cd21593b64cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1199825229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d63e0e-a857-4f8c-a83a-62a6de7f59c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2e84f5e7347cfbe9e4ca4e0cab522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:18Z,use_quota=True,user_id='eaf317f1f3f04548b9401f1d30ed2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677738e8-c1f3-428d-9804-c7c99fa62778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677738e8-c1f3-428d-9804-c7c99fa62778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d2e20d-25d4-44ca-834c-5de51ab4d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d2e20d-25d4-44ca-834c-5de51ab4d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d63e0e-a857-4f8c-a83a-62a6de7f59c5', 'volume_name': 'volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6267fc5c-1294-4179-bc8d-323401419aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6267fc5c-1294-4179-bc8d-323401419aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26a6283-c2d3-46e8-82bf-243070f1f764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:18 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Volume 48d63e0e-a857-4f8c-a83a-62a6de7f59c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5', 'volume_size': 1}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1199825229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d63e0e-a857-4f8c-a83a-62a6de7f59c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2e84f5e7347cfbe9e4ca4e0cab522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:18Z,use_quota=True,user_id='eaf317f1f3f04548b9401f1d30ed2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Creating volume 48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:18 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:18 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 1073741824
Apr 15 23:26:18 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:18 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 1073741824" returned: 0 in 0.449s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:19 devstack sudo[89584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5
Apr 15 23:26:19 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:19 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" returned: 0 in 0.384s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26a6283-c2d3-46e8-82bf-243070f1f764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda963b5-eef1-402b-a07c-f41c6a58291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:19 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Volume volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 (48d63e0e-a857-4f8c-a83a-62a6de7f59c5): created successfully
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda963b5-eef1-402b-a07c-f41c6a58291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (e860202c-956b-4ece-97d1-b591e565ef14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:19 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4b4afa3a-3627-4bcc-8907-ad62457f1bad tempest-VolumesSnapshotTestJSON-1308288313 None] Created volume successfully.
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Creating offline snapshot 9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 of volume 48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[511852a8-c211-4fe6-8796-3173277b96f7]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:19 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5
Apr 15 23:26:19 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:20 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" returned: 0 in 0.451s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:20 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 1G
Apr 15 23:26:20 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:20 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 1G" returned: 0 in 0.437s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:20 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1
Apr 15 23:26:20 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:20 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" returned: 0 in 0.417s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:20 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 is being set with open permissions: ugo+rw
Apr 15 23:26:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:20 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1
Apr 15 23:26:20 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:21 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" returned: 0 in 0.389s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:21 devstack sudo[89605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.info
Apr 15 23:26:21 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:21 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.info" returned: 0 in 0.399s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:21 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.info is being set with open permissions: ugo+rw
Apr 15 23:26:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:21 devstack sudo[89608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.info
Apr 15 23:26:21 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:22 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.info" returned: 0 in 0.389s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:22 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a792bcef-366c-4b12-ad57-68b01b39abf8 tempest-VolumesSnapshotTestJSON-1308288313 None] Create snapshot completed successfully
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (4fc19493-7fd5-4be1-a0b6-67a4235abceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d1203f-d9de-4c70-accf-745d0e19784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d1203f-d9de-4c70-accf-745d0e19784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-294571138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e2864b-3a9d-4b6c-8234-55cf69827f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2e84f5e7347cfbe9e4ca4e0cab522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:23Z,use_quota=True,user_id='eaf317f1f3f04548b9401f1d30ed2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c768b3bb-cb88-4a45-80c8-a7686c62008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c768b3bb-cb88-4a45-80c8-a7686c62008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655ffffa-385c-4178-b740-828beb6ca75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655ffffa-385c-4178-b740-828beb6ca75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7e2864b-3a9d-4b6c-8234-55cf69827f37', 'volume_name': 'volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37', 'volume_size': 2, 'snapshot_id': '9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21ca69f-8d83-40e5-a815-9acf4c9a286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21ca69f-8d83-40e5-a815-9acf4c9a286d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede6d248-1c52-4580-b766-a00c88c2adf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:22 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Volume e7e2864b-3a9d-4b6c-8234-55cf69827f37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37', 'volume_size': 2, 'snapshot_id': '9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1'}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1-e7e2864b-3a9d-4b6c-8234-55cf69827f37" by "_create_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1-e7e2864b-3a9d-4b6c-8234-55cf69827f37" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Creating volume e7e2864b-3a9d-4b6c-8234-55cf69827f37 from snapshot 9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 {{(pid=81941) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-e7e2864b-3a9d-4b6c-8234-55cf69827f37" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-e7e2864b-3a9d-4b6c-8234-55cf69827f37" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] snapshot: 9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1, volume: e7e2864b-3a9d-4b6c-8234-55cf69827f37,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[47944592-8217-4c48-95d7-718d205842b7]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:23 devstack sudo[89611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1
Apr 15 23:26:23 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:23 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b09145-480e-4ce1-a3db-a3f7c99f4fbe]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:23 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5
Apr 15 23:26:23 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:23 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" returned: 0 in 0.458s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:26:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:23 devstack sudo[89621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37
Apr 15 23:26:23 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:25 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37" returned: 0 in 1.846s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:25 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0edeea-30f0-469f-b7e2-42a17255bd4d]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:25 devstack sudo[89635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5
Apr 15 23:26:25 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:26 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" returned: 0 in 0.604s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:26:26 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Converted 1024.00 MB image at 554.23 MB/s
Apr 15 23:26:26 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37 is being set with open permissions: ugo+rw
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:26 devstack sudo[89640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37
Apr 15 23:26:26 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:26 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37" returned: 0 in 0.388s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-e7e2864b-3a9d-4b6c-8234-55cf69827f37" released by "_copy_volume_from_snapshot" :: held 3.794s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1-e7e2864b-3a9d-4b6c-8234-55cf69827f37" released by "_create_volume_from_snapshot" :: held 3.810s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.818s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede6d248-1c52-4580-b766-a00c88c2adf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37', 'volume_size': 2, 'snapshot_id': '9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac88412a-d515-4d1b-a7d9-2904502098d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:26 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Volume volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37 (e7e2864b-3a9d-4b6c-8234-55cf69827f37): created successfully
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac88412a-d515-4d1b-a7d9-2904502098d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:26 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (4fc19493-7fd5-4be1-a0b6-67a4235abceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:26 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-169fa0eb-548e-4be2-9eb5-122f5a27e20d tempest-VolumesSnapshotTestJSON-1308288313 None] Created volume successfully.
Apr 15 23:26:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-e7e2864b-3a9d-4b6c-8234-55cf69827f37-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-e7e2864b-3a9d-4b6c-8234-55cf69827f37-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-e7e2864b-3a9d-4b6c-8234-55cf69827f37" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-e7e2864b-3a9d-4b6c-8234-55cf69827f37" acquired by "delete_volume" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:27 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[32136584-3df4-405b-a9c9-6a8dbc32aae7]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:27 devstack sudo[89643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37
Apr 15 23:26:27 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:27 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:27 devstack sudo[89648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37
Apr 15 23:26:27 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:28 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e7e2864b-3a9d-4b6c-8234-55cf69827f37" returned: 0 in 0.431s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-e7e2864b-3a9d-4b6c-8234-55cf69827f37" released by "delete_volume" :: held 0.906s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Created reservations ['4e12dabe-5242-4475-bfdc-4a22cabb1e7b', 'd1a0e3c7-d6f7-4f30-bb0d-2326a2de139b', 'df29df05-2f27-40af-9b29-52925ae43729', 'f100e238-8a87-4389-8ed5-738f049dcd52'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:28 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:26:28 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Deleting offline snapshot 9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 of volume 48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] snapshot_file for this snap is: volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd6349a-734c-45bf-9cf5-2c55ed6e8144]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:28 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1
Apr 15 23:26:28 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:28 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.420s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:26:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Deleted volume successfully.
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-cfdb90fc-b3bc-40d5-aeea-3b533a22b755 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-e7e2864b-3a9d-4b6c-8234-55cf69827f37-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:28 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" returned: 0 in 0.464s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c048cd0c-d39d-458a-a085-9c339f199274]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:28 devstack sudo[89659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5
Apr 15 23:26:28 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:29 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" returned: 0 in 0.466s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:29 devstack sudo[89664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1
Apr 15 23:26:29 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:29 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" returned: 0 in 0.459s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:29 devstack sudo[89669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1
Apr 15 23:26:29 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:30 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5.9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" returned: 0 in 0.434s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1" released by "_delete_snapshot" :: held 1.872s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" released by "delete_snapshot" :: held 1.886s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Created reservations ['b942b892-31c3-40ae-8715-805208f0582d', 'dbeb2322-175c-4797-964f-a64ed159694e', '778a952b-bdad-43ae-818a-15a47e942069', '422ab735-04a1-4745-9915-485320882768'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:30 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Delete snapshot completed successfully.
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-18ae11c0-9f07-4179-ade6-aa876382bd0b tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-9d9bc1ae-cfa0-4b4a-ae79-1870127aa1c1-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-48d63e0e-a857-4f8c-a83a-62a6de7f59c5-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-48d63e0e-a857-4f8c-a83a-62a6de7f59c5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" acquired by "delete_volume" :: waited 0.005s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9b8d36-de8f-441b-8481-5d3fec53ccd8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:30 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5
Apr 15 23:26:30 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:30 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:31 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5
Apr 15 23:26:31 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:31 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" returned: 0 in 0.425s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-48d63e0e-a857-4f8c-a83a-62a6de7f59c5" released by "delete_volume" :: held 0.910s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Created reservations ['42b4a992-994e-485c-b093-77159d939c46', 'a2b742ca-262f-47e5-a752-40b1ca35ebc7', 'b507e06b-f378-4261-b837-0e6ab8bbf0f8', 'b841b11e-f436-4da7-ab61-4507f5806120'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:31 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:26:31 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (e696b8ee-4969-450d-a75d-d5feae840464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abc0daa-4499-4a9d-9987-92d9abe935cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abc0daa-4499-4a9d-9987-92d9abe935cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-748026524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e21ef0-9597-4df5-9193-05739b5ab7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2e84f5e7347cfbe9e4ca4e0cab522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:32Z,use_quota=True,user_id='eaf317f1f3f04548b9401f1d30ed2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8d8a98-626b-49a9-ab15-eecd85ad1423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8d8a98-626b-49a9-ab15-eecd85ad1423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b5f700-3daf-4fbf-bc9a-a7cb3647a7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b5f700-3daf-4fbf-bc9a-a7cb3647a7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e21ef0-9597-4df5-9193-05739b5ab7f5', 'volume_name': 'volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0716d92c-8abc-40ed-a64b-bc27b74c0ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0716d92c-8abc-40ed-a64b-bc27b74c0ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8435c1-b484-47d9-a920-3d7b4e0bbf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:31 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Volume f7e21ef0-9597-4df5-9193-05739b5ab7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5', 'volume_size': 1}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-748026524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e21ef0-9597-4df5-9193-05739b5ab7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2e84f5e7347cfbe9e4ca4e0cab522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:32Z,use_quota=True,user_id='eaf317f1f3f04548b9401f1d30ed2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Creating volume f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:31 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:31 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 1073741824
Apr 15 23:26:31 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:31 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.479s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:26:31 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Deleted volume successfully.
Apr 15 23:26:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3435e269-5d6c-4b0e-94fa-a22b57ff1d3d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-48d63e0e-a857-4f8c-a83a-62a6de7f59c5-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:32 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 1073741824" returned: 0 in 0.467s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:32 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5
Apr 15 23:26:32 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:32 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5" returned: 0 in 0.407s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8435c1-b484-47d9-a920-3d7b4e0bbf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b096c514-712d-4342-9923-f9c19297b40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:32 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Volume volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 (f7e21ef0-9597-4df5-9193-05739b5ab7f5): created successfully
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b096c514-712d-4342-9923-f9c19297b40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (e696b8ee-4969-450d-a75d-d5feae840464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:32 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1b5b0c7d-fdf0-421b-90a7-3ebe2fc427f6 tempest-VolumesSnapshotTestJSON-1308288313 None] Created volume successfully.
Apr 15 23:26:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:34 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Creating offline snapshot 19bf4876-aa01-470d-a1d6-2ea17c9464ef of volume f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:26:34 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce74f61-2c2a-4823-8ea2-b5a46d838006]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:34 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5
Apr 15 23:26:34 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:34 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5" returned: 0 in 0.461s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:34 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef 1G
Apr 15 23:26:34 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:35 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef 1G" returned: 0 in 0.479s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:35 devstack sudo[89707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef
Apr 15 23:26:35 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:35 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef" returned: 0 in 0.413s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:35 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef is being set with open permissions: ugo+rw
Apr 15 23:26:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:35 devstack sudo[89713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef
Apr 15 23:26:35 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:35 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef" returned: 0 in 0.389s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:35 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.info
Apr 15 23:26:35 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:36 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.info" returned: 0 in 0.434s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:36 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.info is being set with open permissions: ugo+rw
Apr 15 23:26:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:36 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.info
Apr 15 23:26:36 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:36 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.info" returned: 0 in 0.393s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b31f094e-f27a-400c-a349-61e82e18d769 tempest-VolumesSnapshotTestJSON-1308288313 None] Create snapshot completed successfully
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (be09b4e0-7973-452f-afc2-1b30b8710fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ed5dc7-441f-4fcf-890f-951f54bcb126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ed5dc7-441f-4fcf-890f-951f54bcb126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-937351539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2e84f5e7347cfbe9e4ca4e0cab522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19bf4876-aa01-470d-a1d6-2ea17c9464ef,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:37Z,use_quota=True,user_id='eaf317f1f3f04548b9401f1d30ed2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4569b8-5027-4f6c-b772-351cf25da19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4569b8-5027-4f6c-b772-351cf25da19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02fd637-4c56-4434-8e72-a8a90399dbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02fd637-4c56-4434-8e72-a8a90399dbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32', 'volume_name': 'volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32', 'volume_size': 1, 'snapshot_id': '19bf4876-aa01-470d-a1d6-2ea17c9464ef'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b205b9f-9f75-4e03-a335-d50d461a2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b205b9f-9f75-4e03-a335-d50d461a2b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d7507d-0308-4073-b00b-ecfeb0519981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:37 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Volume 2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32', 'volume_size': 1, 'snapshot_id': '19bf4876-aa01-470d-a1d6-2ea17c9464ef'}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-19bf4876-aa01-470d-a1d6-2ea17c9464ef-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" by "_create_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-19bf4876-aa01-470d-a1d6-2ea17c9464ef-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Creating volume 2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 from snapshot 19bf4876-aa01-470d-a1d6-2ea17c9464ef {{(pid=81941) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] snapshot: 19bf4876-aa01-470d-a1d6-2ea17c9464ef, volume: 2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f181e4-1e54-443c-b8db-d487f341f41e]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:37 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef
Apr 15 23:26:37 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:38 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90608ed-82e4-4980-90ee-1c1eb6effe1f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:38 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5
Apr 15 23:26:38 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:38 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:38 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32
Apr 15 23:26:38 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:40 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" returned: 0 in 1.919s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:40 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b850089-f03a-4852-be0f-fb8bdfac350c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:40 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5
Apr 15 23:26:40 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:41 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5" returned: 0 in 0.611s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:26:41 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Converted 1024.00 MB image at 533.17 MB/s
Apr 15 23:26:41 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 is being set with open permissions: ugo+rw
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:41 devstack sudo[89749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32
Apr 15 23:26:41 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:41 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" returned: 0 in 0.415s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" released by "_copy_volume_from_snapshot" :: held 3.908s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-19bf4876-aa01-470d-a1d6-2ea17c9464ef-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" released by "_create_volume_from_snapshot" :: held 3.921s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.929s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d7507d-0308-4073-b00b-ecfeb0519981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32', 'volume_size': 1, 'snapshot_id': '19bf4876-aa01-470d-a1d6-2ea17c9464ef'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5be2a6-bbf9-4428-9f96-c12272497a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Volume volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 (2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32): created successfully
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5be2a6-bbf9-4428-9f96-c12272497a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Flow 'volume_create_manager' (be09b4e0-7973-452f-afc2-1b30b8710fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-245a4ee8-7b49-4ec9-81e1-e00ca3f5e58d tempest-VolumesSnapshotTestJSON-1308288313 None] Created volume successfully.
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d3cda3-32db-47fb-9a46-edd4350df8fa]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:41 devstack sudo[89752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32
Apr 15 23:26:41 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:42 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" returned: 0 in 0.473s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:42 devstack sudo[89757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32
Apr 15 23:26:42 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:42 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" returned: 0 in 0.417s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32" released by "delete_volume" :: held 0.918s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Created reservations ['3a50b4d0-974d-430b-b08b-d91a47cc366c', '4a71496a-725d-453d-82d5-09dc8e93351b', '9f1545f5-ea5a-4b32-9705-bac39d156df8', 'f0543358-64b6-4f79-a5f6-adb79529d6f3'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:42 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:26:42 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-19bf4876-aa01-470d-a1d6-2ea17c9464ef-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-19bf4876-aa01-470d-a1d6-2ea17c9464ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-f7e21ef0-9597-4df5-9193-05739b5ab7f5" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-f7e21ef0-9597-4df5-9193-05739b5ab7f5" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-19bf4876-aa01-470d-a1d6-2ea17c9464ef" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-19bf4876-aa01-470d-a1d6-2ea17c9464ef" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Deleting offline snapshot 19bf4876-aa01-470d-a1d6-2ea17c9464ef of volume f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] snapshot_file for this snap is: volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a71c509-d520-4587-aba0-11da8e43ebec]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:43 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef
Apr 15 23:26:43 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:43 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:26:43 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Deleted volume successfully.
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fdc0fd80-3edb-4927-8ea2-031e7f141dcb tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-2dca89cb-9de2-4bd6-aa1d-e04e36dc1b32-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:43 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef" returned: 0 in 0.506s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[918f0def-c6ae-4d7f-9a82-2c7d5609a088]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:43 devstack sudo[89803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5
Apr 15 23:26:43 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:43 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5" returned: 0 in 0.484s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:43 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef
Apr 15 23:26:43 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:44 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:44 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef
Apr 15 23:26:44 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:44 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5.19bf4876-aa01-470d-a1d6-2ea17c9464ef" returned: 0 in 0.414s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-19bf4876-aa01-470d-a1d6-2ea17c9464ef" released by "_delete_snapshot" :: held 1.944s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-f7e21ef0-9597-4df5-9193-05739b5ab7f5" released by "delete_snapshot" :: held 1.962s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:44 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Created reservations ['daacf0cc-0cfa-4f97-983b-3c7ba334e9d1', '5e57e9ea-c5ef-4fd7-ab56-a2f466435324', '12c6ece8-83c3-4b2b-9a8d-631c7c92669c', '75a3afc5-21df-4316-9452-b111d10588f7'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:44 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Delete snapshot completed successfully.
Apr 15 23:26:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1e10b47b-9d92-4a2e-b913-24c135261228 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-19bf4876-aa01-470d-a1d6-2ea17c9464ef-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-f7e21ef0-9597-4df5-9193-05739b5ab7f5-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-f7e21ef0-9597-4df5-9193-05739b5ab7f5-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-f7e21ef0-9597-4df5-9193-05739b5ab7f5" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-f7e21ef0-9597-4df5-9193-05739b5ab7f5" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:45 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23deb8a-b80b-43d3-9b3d-e7abfa8a35ad]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:45 devstack sudo[89816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5
Apr 15 23:26:45 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:45 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5" returned: 0 in 0.491s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:45 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5
Apr 15 23:26:45 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:46 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f7e21ef0-9597-4df5-9193-05739b5ab7f5" returned: 0 in 0.446s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-f7e21ef0-9597-4df5-9193-05739b5ab7f5" released by "delete_volume" :: held 0.972s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Created reservations ['eebd8147-9651-442c-809b-61fe405bced5', '209774e8-68dd-44ce-999f-41a695aed81c', 'd23b7777-3b51-411c-a36c-5b22752a9d24', '5b9a04ec-4509-40ac-9270-c3a61081eef7'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:46 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:26:46 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-506f4923-392f-4d3a-84d9-def42b86402c-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-506f4923-392f-4d3a-84d9-def42b86402c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "cinder-quobyte-506f4923-392f-4d3a-84d9-def42b86402c" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-506f4923-392f-4d3a-84d9-def42b86402c" acquired by "delete_volume" :: waited 0.019s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[278f0f65-a6fc-4896-84c2-23cb72a99835]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:46 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c
Apr 15 23:26:46 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:46 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.446s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:26:46 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Deleted volume successfully.
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-10aadd6e-d919-45eb-b779-1c2444d65679 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-f7e21ef0-9597-4df5-9193-05739b5ab7f5-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:46 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:46 devstack sudo[89833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c
Apr 15 23:26:46 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:47 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-506f4923-392f-4d3a-84d9-def42b86402c" returned: 0 in 0.394s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-quobyte-506f4923-392f-4d3a-84d9-def42b86402c" released by "delete_volume" :: held 0.900s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Created reservations ['edc7db42-6016-4acb-bc9d-b0e697150062', 'ae3a71a5-f056-439e-828d-cdc439f0f638', 'aad4ef90-2d30-4d74-9f0b-69da43533df9', '8b5a0e5f-b368-485c-9071-804605c407ac'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:47 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:26:47 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:47 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.428s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:26:47 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Deleted volume successfully.
Apr 15 23:26:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-2545a2bb-ec3f-436c-a90f-b1ed077fbab7 tempest-VolumesSnapshotTestJSON-1308288313 None] Lock "cinder-506f4923-392f-4d3a-84d9-def42b86402c-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (c3d62e93-d37b-48f7-983d-3795aacbf5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5b55d0-6eb1-4b83-ad89-1da1ad96a008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5b55d0-6eb1-4b83-ad89-1da1ad96a008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-680684763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40f38a7-2b18-4275-bc2d-cd03d876b9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:51Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a17afe-e246-4b32-b180-39989abe3105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a17afe-e246-4b32-b180-39989abe3105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57477679-e06c-4ecd-ab8f-489f7eb701d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57477679-e06c-4ecd-ab8f-489f7eb701d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd40f38a7-2b18-4275-bc2d-cd03d876b9bf', 'volume_name': 'volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f75f1e-b018-44a4-9657-3e0f6132d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f75f1e-b018-44a4-9657-3e0f6132d03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b487db2-d2a2-4ccf-b2a3-eac05b1903ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:51 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume d40f38a7-2b18-4275-bc2d-cd03d876b9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf', 'volume_size': 1}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-680684763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40f38a7-2b18-4275-bc2d-cd03d876b9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:51Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Creating volume d40f38a7-2b18-4275-bc2d-cd03d876b9bf {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:51 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:51 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf 1073741824
Apr 15 23:26:51 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:51 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf 1073741824" returned: 0 in 0.494s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:51 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf
Apr 15 23:26:51 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:52 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" returned: 0 in 0.435s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:26:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b487db2-d2a2-4ccf-b2a3-eac05b1903ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5df219-ee46-44a6-aad8-2b0572fdfddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:52 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf (d40f38a7-2b18-4275-bc2d-cd03d876b9bf): created successfully
Apr 15 23:26:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5df219-ee46-44a6-aad8-2b0572fdfddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (c3d62e93-d37b-48f7-983d-3795aacbf5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:52 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cb0e4984-8c15-4b12-b901-f53e7daab6f1 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created volume successfully.
Apr 15 23:26:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Creating offline snapshot c9ba95bb-4667-4651-b6b7-363cd5ed8fdd of volume d40f38a7-2b18-4275-bc2d-cd03d876b9bf {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:26:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[42294093-e4ab-4103-b349-3d8458429a5a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:26:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:53 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf
Apr 15 23:26:53 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:54 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" returned: 0 in 0.470s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:54 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd 1G
Apr 15 23:26:54 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:54 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd 1G" returned: 0 in 0.470s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:54 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd
Apr 15 23:26:54 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:54 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd" returned: 0 in 0.451s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:54 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd is being set with open permissions: ugo+rw
Apr 15 23:26:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:55 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd
Apr 15 23:26:55 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:55 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd" returned: 0 in 0.387s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:55 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.info
Apr 15 23:26:55 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:55 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.info" returned: 0 in 0.421s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:55 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.info is being set with open permissions: ugo+rw
Apr 15 23:26:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:55 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.info
Apr 15 23:26:55 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:56 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.info" returned: 0 in 0.393s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:56 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2ffd2bd1-6d92-4e10-9b4c-7c1070b42a94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Create snapshot completed successfully
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (623929d3-e1fc-4621-991b-b5b2f44efbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18bfcb4-fae4-4d68-af4f-70272fb0d9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18bfcb4-fae4-4d68-af4f-70272fb0d9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142132968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd345a26-d7c4-4960-bb1d-aa002acd330a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:57Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e843ea8c-65cf-49b7-ad04-2124913e0fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e843ea8c-65cf-49b7-ad04-2124913e0fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063d30a4-81fe-43fd-b7a6-b7aa87ddd3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063d30a4-81fe-43fd-b7a6-b7aa87ddd3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd345a26-d7c4-4960-bb1d-aa002acd330a', 'volume_name': 'volume-cd345a26-d7c4-4960-bb1d-aa002acd330a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d9b8e4-e5b0-4aa3-855d-f15c7d5836ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d9b8e4-e5b0-4aa3-855d-f15c7d5836ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1cd286-9d8d-4e33-bb95-f4667f3de607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:56 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume cd345a26-d7c4-4960-bb1d-aa002acd330a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd345a26-d7c4-4960-bb1d-aa002acd330a', 'volume_size': 1}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142132968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd345a26-d7c4-4960-bb1d-aa002acd330a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:57Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Creating volume cd345a26-d7c4-4960-bb1d-aa002acd330a {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:56 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:26:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:56 devstack sudo[89875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a 1073741824
Apr 15 23:26:56 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (b68334ea-b533-44b8-8fde-9c0f7266b722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2bf256-f549-442c-836f-e07b8697a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2bf256-f549-442c-836f-e07b8697a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-936691519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff0312e-1c53-4e1b-b10c-b06397b62603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:57Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92f5b43-59e9-4e94-8f34-6f9c4302c8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92f5b43-59e9-4e94-8f34-6f9c4302c8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53f1c25-b71f-4444-9046-11a2c0485124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53f1c25-b71f-4444-9046-11a2c0485124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff0312e-1c53-4e1b-b10c-b06397b62603', 'volume_name': 'volume-7ff0312e-1c53-4e1b-b10c-b06397b62603', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933e8fa4-4b3e-4d1a-bab0-1e15106a5540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933e8fa4-4b3e-4d1a-bab0-1e15106a5540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa42ea2-86cf-41c8-965d-27184fa942f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume 7ff0312e-1c53-4e1b-b10c-b06397b62603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff0312e-1c53-4e1b-b10c-b06397b62603', 'volume_size': 1}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:57 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:26:57 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (6f12474f-47ff-4a55-837c-80417baa587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3e1f42-caaa-4802-88f3-40a7f62a389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3e1f42-caaa-4802-88f3-40a7f62a389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-688194094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8e24b7-109e-4fc5-b304-cf16761a73f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:57Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc83d151-9eea-4b6b-977d-4264d7b4c685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc83d151-9eea-4b6b-977d-4264d7b4c685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5efec0-22c6-42e7-8c92-d6816ff3eafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5efec0-22c6-42e7-8c92-d6816ff3eafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8e24b7-109e-4fc5-b304-cf16761a73f5', 'volume_name': 'volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31f1697-5bea-4212-85a6-d185628ff4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31f1697-5bea-4212-85a6-d185628ff4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca25f819-8436-4232-9ccb-d5692ecad588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume 0e8e24b7-109e-4fc5-b304-cf16761a73f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5', 'volume_size': 1}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (c5807f83-a6b0-40a1-a28e-db429d880d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9d29be-ccb4-4a2c-aa47-8a09b0dca234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9d29be-ccb4-4a2c-aa47-8a09b0dca234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-391778529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61acf54a-69e0-4fd6-8998-e5fac9937db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:57Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae09262-129f-496e-8c9b-15092991ddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae09262-129f-496e-8c9b-15092991ddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c5604b-2947-463b-8438-8fa7db84d743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c5604b-2947-463b-8438-8fa7db84d743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61acf54a-69e0-4fd6-8998-e5fac9937db7', 'volume_name': 'volume-61acf54a-69e0-4fd6-8998-e5fac9937db7', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0456202-f1a6-4ad7-9c21-8bf61f2975f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0456202-f1a6-4ad7-9c21-8bf61f2975f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ce1d97-b5e3-45b8-97df-cb2e68a6c1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume 61acf54a-69e0-4fd6-8998-e5fac9937db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61acf54a-69e0-4fd6-8998-e5fac9937db7', 'volume_size': 1}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a 1073741824" returned: 0 in 0.624s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:57 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a
Apr 15 23:26:57 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:57 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.501s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (3d8c6404-0098-4210-9785-40a1c7fd2cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65af432e-ca0a-4698-8b0b-3b52411e2fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65af432e-ca0a-4698-8b0b-3b52411e2fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1896728791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efbc2e7-722f-4432-9c5b-0d75dc1ea926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:58Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76b8e39-0d90-415f-8c71-9c214b07804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76b8e39-0d90-415f-8c71-9c214b07804f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a371538d-feeb-444b-bb95-948507dc498a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a371538d-feeb-444b-bb95-948507dc498a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efbc2e7-722f-4432-9c5b-0d75dc1ea926', 'volume_name': 'volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71bad6a-afa7-46d8-b2fd-095fdbdc6cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71bad6a-afa7-46d8-b2fd-095fdbdc6cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa5c245-ea70-4ced-b50e-c222acbfca86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:57 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume 4efbc2e7-722f-4432-9c5b-0d75dc1ea926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926', 'volume_size': 1}
Apr 15 23:26:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:58 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a" returned: 0 in 0.435s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-936691519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff0312e-1c53-4e1b-b10c-b06397b62603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:57Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Creating volume 7ff0312e-1c53-4e1b-b10c-b06397b62603 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:58 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1cd286-9d8d-4e33-bb95-f4667f3de607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd345a26-d7c4-4960-bb1d-aa002acd330a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbba2c0b-fb34-4668-b7c0-efc7d44bd39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:58 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603 1073741824
Apr 15 23:26:58 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:58 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume volume-cd345a26-d7c4-4960-bb1d-aa002acd330a (cd345a26-d7c4-4960-bb1d-aa002acd330a): created successfully
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbba2c0b-fb34-4668-b7c0-efc7d44bd39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (623929d3-e1fc-4621-991b-b5b2f44efbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:58 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-2f5c33e9-cfcd-4b2a-8a51-0af3c82b6a09 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created volume successfully.
Apr 15 23:26:58 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603 1073741824" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:58 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603
Apr 15 23:26:58 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:58 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603" returned: 0 in 0.409s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-688194094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8e24b7-109e-4fc5-b304-cf16761a73f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:57Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Creating volume 0e8e24b7-109e-4fc5-b304-cf16761a73f5 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:58 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=83,cinder:INSERT=26,cinder:UPDATE=101,cinder:DELETE=8 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa42ea2-86cf-41c8-965d-27184fa942f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff0312e-1c53-4e1b-b10c-b06397b62603', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18de7f5e-47c7-4722-a4f5-167cf5bcbd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:58 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5 1073741824
Apr 15 23:26:58 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:58 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:UPDATE=88,cinder:SELECT=91,cinder:INSERT=20,cinder:DELETE=9 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:26:58 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume volume-7ff0312e-1c53-4e1b-b10c-b06397b62603 (7ff0312e-1c53-4e1b-b10c-b06397b62603): created successfully
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18de7f5e-47c7-4722-a4f5-167cf5bcbd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (b68334ea-b533-44b8-8fde-9c0f7266b722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:59 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6f1ec258-3c53-42b5-86a3-370c3c8e4d45 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created volume successfully.
Apr 15 23:26:59 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5 1073741824" returned: 0 in 0.473s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:59 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5
Apr 15 23:26:59 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:59 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5" returned: 0 in 0.435s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.320s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-391778529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61acf54a-69e0-4fd6-8998-e5fac9937db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:57Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Creating volume 61acf54a-69e0-4fd6-8998-e5fac9937db7 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:26:59 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca25f819-8436-4232-9ccb-d5692ecad588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:59 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7 1073741824
Apr 15 23:26:59 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1731ca06-ec24-4496-9ff6-3f434eb35cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:26:59 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5 (0e8e24b7-109e-4fc5-b304-cf16761a73f5): created successfully
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1731ca06-ec24-4496-9ff6-3f434eb35cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:26:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (6f12474f-47ff-4a55-837c-80417baa587a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:26:59 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b5cd040f-10c4-4752-ab3a-fdddf00f886b tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created volume successfully.
Apr 15 23:27:00 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7 1073741824" returned: 0 in 0.482s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:00 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7
Apr 15 23:27:00 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:00 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7" returned: 0 in 0.411s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.019s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1896728791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efbc2e7-722f-4432-9c5b-0d75dc1ea926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bafc6e8f43c45b791fb8fdf2b5b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:58Z,use_quota=True,user_id='21ce614a6b5541a695ddddbea94c0e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Creating volume 4efbc2e7-722f-4432-9c5b-0d75dc1ea926 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:00 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ce1d97-b5e3-45b8-97df-cb2e68a6c1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61acf54a-69e0-4fd6-8998-e5fac9937db7', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d31e4e-e779-48b5-b86e-b96ddf8a2c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:00 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926 1073741824
Apr 15 23:27:00 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:00 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume volume-61acf54a-69e0-4fd6-8998-e5fac9937db7 (61acf54a-69e0-4fd6-8998-e5fac9937db7): created successfully
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d31e4e-e779-48b5-b86e-b96ddf8a2c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:00 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (c5807f83-a6b0-40a1-a28e-db429d880d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:00 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f23665b9-9a74-4929-87e4-2f66b520aa8a tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created volume successfully.
Apr 15 23:27:01 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926 1073741824" returned: 0 in 0.472s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:01 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926
Apr 15 23:27:01 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:01 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926" returned: 0 in 0.385s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa5c245-ea70-4ced-b50e-c222acbfca86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a35d00-afb6-49c6-914b-a1e80f9c1b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:01 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Volume volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926 (4efbc2e7-722f-4432-9c5b-0d75dc1ea926): created successfully
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a35d00-afb6-49c6-914b-a1e80f9c1b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:01 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Flow 'volume_create_manager' (3d8c6404-0098-4210-9785-40a1c7fd2cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:01 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-abc82be0-422f-499f-a79d-b96916a4975e tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created volume successfully.
Apr 15 23:27:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-4efbc2e7-722f-4432-9c5b-0d75dc1ea926-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-4efbc2e7-722f-4432-9c5b-0d75dc1ea926-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-quobyte-4efbc2e7-722f-4432-9c5b-0d75dc1ea926" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-4efbc2e7-722f-4432-9c5b-0d75dc1ea926" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:02 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0cdf43-2dde-4530-84e7-3a6c8e5a677b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:02 devstack sudo[89920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926
Apr 15 23:27:02 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:02 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:02 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926
Apr 15 23:27:02 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:03 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-4efbc2e7-722f-4432-9c5b-0d75dc1ea926" returned: 0 in 0.386s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-4efbc2e7-722f-4432-9c5b-0d75dc1ea926" released by "delete_volume" :: held 0.856s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created reservations ['b66f45c7-7518-47bf-9fe9-b54658da3a15', '4f3b6798-e921-4b22-b041-afa728d0b64b', 'd5d7b66b-bfbc-4056-b1f1-0595b3c3e447', '252e91b2-8744-44e9-a965-0d73e41893c5'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:03 devstack sudo[89928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:03 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-61acf54a-69e0-4fd6-8998-e5fac9937db7-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-61acf54a-69e0-4fd6-8998-e5fac9937db7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-quobyte-61acf54a-69e0-4fd6-8998-e5fac9937db7" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-61acf54a-69e0-4fd6-8998-e5fac9937db7" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdcd557-d476-4e36-89cf-daa419c0cddc]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:03 devstack sudo[89930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7
Apr 15 23:27:03 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:03 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.416s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Deleted volume successfully.
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d329bc78-5f82-41a8-a053-648b497bdd94 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-4efbc2e7-722f-4432-9c5b-0d75dc1ea926-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:03 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7" returned: 0 in 0.447s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:03 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7
Apr 15 23:27:03 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:04 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-61acf54a-69e0-4fd6-8998-e5fac9937db7" returned: 0 in 0.395s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-61acf54a-69e0-4fd6-8998-e5fac9937db7" released by "delete_volume" :: held 0.860s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created reservations ['bc3c1e9b-7ea7-42ed-b6ca-88ab716c1738', 'bf301e38-748d-4241-8e87-75f8fa62a8cc', 'edac87aa-d7ca-42ad-b610-8df7b81159ad', 'f1007957-6ff3-4710-9a24-1ae43303ef00'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:04 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:04 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-0e8e24b7-109e-4fc5-b304-cf16761a73f5-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-0e8e24b7-109e-4fc5-b304-cf16761a73f5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-quobyte-0e8e24b7-109e-4fc5-b304-cf16761a73f5" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-0e8e24b7-109e-4fc5-b304-cf16761a73f5" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c5396c-93dc-41e5-8abc-108d21a942ac]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:04 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5
Apr 15 23:27:04 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:04 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.442s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:04 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Deleted volume successfully.
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-573d79fd-5d73-4243-a0e7-32b8a21db41c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-61acf54a-69e0-4fd6-8998-e5fac9937db7-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:04 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5" returned: 0 in 0.496s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:04 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5
Apr 15 23:27:04 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:05 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-0e8e24b7-109e-4fc5-b304-cf16761a73f5" returned: 0 in 0.398s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-0e8e24b7-109e-4fc5-b304-cf16761a73f5" released by "delete_volume" :: held 0.913s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created reservations ['07514b39-4aa2-43ae-9965-e00a446b9947', 'd7a6f68d-aee8-4c6d-9435-95a214329f6b', 'ff5d272a-775b-49be-9939-7edb57ba0b97', 'dca71fd5-b5e5-4cd3-89e5-51ba31d4767b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:05 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:05 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-7ff0312e-1c53-4e1b-b10c-b06397b62603-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-7ff0312e-1c53-4e1b-b10c-b06397b62603-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-quobyte-7ff0312e-1c53-4e1b-b10c-b06397b62603" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-7ff0312e-1c53-4e1b-b10c-b06397b62603" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b548f8-c893-4acb-9c65-b406ee70dd8c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:05 devstack sudo[89953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603
Apr 15 23:27:05 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:05 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.443s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:05 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Deleted volume successfully.
Apr 15 23:27:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9e742f41-6edd-4e08-87f9-22a894aa2c93 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-0e8e24b7-109e-4fc5-b304-cf16761a73f5-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:06 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603" returned: 0 in 0.464s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:06 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603
Apr 15 23:27:06 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:06 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7ff0312e-1c53-4e1b-b10c-b06397b62603" returned: 0 in 0.392s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-7ff0312e-1c53-4e1b-b10c-b06397b62603" released by "delete_volume" :: held 0.877s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created reservations ['dc3be216-e589-40b3-bcd4-d690bd67ec01', '6bbd18c9-6019-4f71-bcf1-e3b90edb8d12', '5e43af64-9888-461e-9f3e-a3d2ac88014e', 'f845822c-666f-44ce-9bfa-3584a032f1f5'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:06 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:06 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-cd345a26-d7c4-4960-bb1d-aa002acd330a-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-cd345a26-d7c4-4960-bb1d-aa002acd330a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-quobyte-cd345a26-d7c4-4960-bb1d-aa002acd330a" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-cd345a26-d7c4-4960-bb1d-aa002acd330a" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[664c6c92-92c3-43ac-b60a-b925e44bcadb]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:06 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a
Apr 15 23:27:06 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:06 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.421s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:06 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Deleted volume successfully.
Apr 15 23:27:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e6a0060a-c7ad-4b86-82e4-e19be6d5e931 tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-7ff0312e-1c53-4e1b-b10c-b06397b62603-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:07 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a" returned: 0 in 0.458s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:07 devstack sudo[89970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a
Apr 15 23:27:07 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:07 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-cd345a26-d7c4-4960-bb1d-aa002acd330a" returned: 0 in 0.387s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-cd345a26-d7c4-4960-bb1d-aa002acd330a" released by "delete_volume" :: held 0.864s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created reservations ['5cefea84-81c6-46da-b6cd-5e86a6df806e', 'acf4584a-e0b1-4f37-82d9-440c30e120a5', 'd89b4b03-c510-4bb9-a4f3-d85e46bb4279', 'edd83646-33a7-46a6-8a76-b066f7414f17'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:07 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:07 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-c9ba95bb-4667-4651-b6b7-363cd5ed8fdd-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-c9ba95bb-4667-4651-b6b7-363cd5ed8fdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-quobyte-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-quobyte-c9ba95bb-4667-4651-b6b7-363cd5ed8fdd" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-c9ba95bb-4667-4651-b6b7-363cd5ed8fdd" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Deleting offline snapshot c9ba95bb-4667-4651-b6b7-363cd5ed8fdd of volume d40f38a7-2b18-4275-bc2d-cd03d876b9bf {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] snapshot_file for this snap is: volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5b2891-7b9c-4052-a33f-0734fbdc8328]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:07 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd
Apr 15 23:27:07 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:08 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:08 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Deleted volume successfully.
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-21c4a72d-418b-4da2-b2c9-5e96ca4624bf tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-cd345a26-d7c4-4960-bb1d-aa002acd330a-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:08 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd" returned: 0 in 0.451s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e120d53-e946-4afa-bb65-0ed822bad645]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:08 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf
Apr 15 23:27:08 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:08 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" returned: 0 in 0.443s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:08 devstack sudo[89986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd
Apr 15 23:27:08 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:09 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd" returned: 0 in 0.429s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:09 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd
Apr 15 23:27:09 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:09 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf.c9ba95bb-4667-4651-b6b7-363cd5ed8fdd" returned: 0 in 0.386s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-c9ba95bb-4667-4651-b6b7-363cd5ed8fdd" released by "_delete_snapshot" :: held 1.757s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" released by "delete_snapshot" :: held 1.766s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created reservations ['4f1fc255-5fb2-4b15-8d47-5e704c48dad9', '675de949-6585-4ab5-895f-1901208e10ee', '2d1a467e-3254-4e13-8792-ece06c5cd0f9', '7d7a5035-42e7-4c66-a18a-15eed7014e93'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:09 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Delete snapshot completed successfully.
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-694b6e8e-3f0d-464a-9ea9-d6dd703f745c tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-c9ba95bb-4667-4651-b6b7-363cd5ed8fdd-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-d40f38a7-2b18-4275-bc2d-cd03d876b9bf-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-d40f38a7-2b18-4275-bc2d-cd03d876b9bf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "cinder-quobyte-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f71cf6-0883-41eb-a6ae-906ea80952eb]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:09 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf
Apr 15 23:27:09 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:10 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" returned: 0 in 0.447s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:10 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf
Apr 15 23:27:10 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:10 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" returned: 0 in 0.396s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-quobyte-d40f38a7-2b18-4275-bc2d-cd03d876b9bf" released by "delete_volume" :: held 0.875s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Created reservations ['a7c8f306-2fed-419d-8f68-83f9f5950b81', '2f5c3161-356c-4f14-8bde-a4a1106f54be', 'a28746b3-265f-4cd1-9682-b5b48af4c852', '189f44b8-b199-4575-b1a2-84eeb51a3fab'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:10 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:10 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:11 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.422s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:11 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:11 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Deleted volume successfully.
Apr 15 23:27:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b505f758-2fe4-4b4e-a951-bbc22084b0ad tempest-CreateVolumesFromSnapshotTest-1445364469 None] Lock "cinder-d40f38a7-2b18-4275-bc2d-cd03d876b9bf-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Flow 'volume_create_manager' (7cb74775-ae3a-4c13-88d5-ef169d37d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3d4a51-cde4-4f9f-9e49-4859fc80500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3d4a51-cde4-4f9f-9e49-4859fc80500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-400230398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d836924b-5258-497e-8567-848ecbcc8b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5029908c7f543a794058e529af72161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='4e33d0041ed74b26b18276d5f5a19488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06cb8bd-7e60-45d7-a922-d97f410e1508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06cb8bd-7e60-45d7-a922-d97f410e1508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1be638-b0a6-4b8a-9909-4e770cebfcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1be638-b0a6-4b8a-9909-4e770cebfcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd836924b-5258-497e-8567-848ecbcc8b9a', 'volume_name': 'volume-d836924b-5258-497e-8567-848ecbcc8b9a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985083c1-05e2-4ba2-bf07-a2da4eeb8f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985083c1-05e2-4ba2-bf07-a2da4eeb8f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5708df96-7762-48d7-a4c4-5487b48a333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Volume d836924b-5258-497e-8567-848ecbcc8b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d836924b-5258-497e-8567-848ecbcc8b9a', 'volume_size': 1}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-400230398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d836924b-5258-497e-8567-848ecbcc8b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5029908c7f543a794058e529af72161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='4e33d0041ed74b26b18276d5f5a19488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Creating volume d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:17 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:17 devstack sudo[90049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a 1073741824
Apr 15 23:27:17 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (b7746de3-4e8e-4bcb-af9e-508f96951578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1fba4c-9434-4615-a4e2-fddc63753b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1fba4c-9434-4615-a4e2-fddc63753b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139682875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42a67c9-7280-4820-bb2d-afef281a0f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2480faee-0c0c-4ac6-b02f-85f40f9b5dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2480faee-0c0c-4ac6-b02f-85f40f9b5dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b58b8c5-d3c7-4909-9f1a-f91cb47bf6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b58b8c5-d3c7-4909-9f1a-f91cb47bf6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42a67c9-7280-4820-bb2d-afef281a0f25', 'volume_name': 'volume-f42a67c9-7280-4820-bb2d-afef281a0f25', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4654bc7a-3b38-4eec-b0d5-bafca4cfbad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4654bc7a-3b38-4eec-b0d5-bafca4cfbad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae02eb0-4aa7-4082-8f57-b4eddea8bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:17 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Volume f42a67c9-7280-4820-bb2d-afef281a0f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42a67c9-7280-4820-bb2d-afef281a0f25', 'volume_size': 1}
Apr 15 23:27:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (67af992c-9a9f-4202-8249-70e91ecac5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ed43b6-9043-488f-8744-fd385b038317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ed43b6-9043-488f-8744-fd385b038317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-842215607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a743674-303f-4292-9521-83dd8e8148e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec20fc46-6a2d-44f0-86a4-7e087b34a5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec20fc46-6a2d-44f0-86a4-7e087b34a5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3d2560-b895-471d-b9a3-8f11bc4934b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3d2560-b895-471d-b9a3-8f11bc4934b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a743674-303f-4292-9521-83dd8e8148e6', 'volume_name': 'volume-9a743674-303f-4292-9521-83dd8e8148e6', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efe3fca-e9e9-4d0b-b2ad-a25fd0fd73f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efe3fca-e9e9-4d0b-b2ad-a25fd0fd73f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0dcf9c-af8e-4019-8f99-a99b52d14b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume 9a743674-303f-4292-9521-83dd8e8148e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a743674-303f-4292-9521-83dd8e8148e6', 'volume_size': 1}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (30f69c6a-9056-4c0c-892d-d9f4a0d24b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1694f7bf-22f4-4cb8-aabf-6bc3e2d6eadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1694f7bf-22f4-4cb8-aabf-6bc3e2d6eadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1502016196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72220b30-8730-46c3-9ac6-5c2406304645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68d1bf1-4e2a-4782-bdcf-fa9b0a89d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68d1bf1-4e2a-4782-bdcf-fa9b0a89d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11a34c6-ecce-4a2b-8466-74d3105cdbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11a34c6-ecce-4a2b-8466-74d3105cdbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72220b30-8730-46c3-9ac6-5c2406304645', 'volume_name': 'volume-72220b30-8730-46c3-9ac6-5c2406304645', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb5a386-ee8a-48d4-8101-1b4f9bc1b362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb5a386-ee8a-48d4-8101-1b4f9bc1b362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9039b196-9792-475a-bfa1-f3c10a6118af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Volume 72220b30-8730-46c3-9ac6-5c2406304645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72220b30-8730-46c3-9ac6-5c2406304645', 'volume_size': 1}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (0b9dd28b-1de3-4c5e-b295-d19fd13bc5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0002f272-cee4-4a3f-98d8-1ed929dbf5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0002f272-cee4-4a3f-98d8-1ed929dbf5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569799865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c51eb2-d322-4449-b5ce-194becf18cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8586a40f-9659-4485-8fab-93b06ce1b3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8586a40f-9659-4485-8fab-93b06ce1b3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4276e840-b3d1-4034-82b8-6c4109d8c8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4276e840-b3d1-4034-82b8-6c4109d8c8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c51eb2-d322-4449-b5ce-194becf18cba', 'volume_name': 'volume-00c51eb2-d322-4449-b5ce-194becf18cba', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a05af3-852f-43fb-9d30-c51784ebf5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a05af3-852f-43fb-9d30-c51784ebf5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c89dff-95e8-4991-a108-4b613747f8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Volume 00c51eb2-d322-4449-b5ce-194becf18cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c51eb2-d322-4449-b5ce-194becf18cba', 'volume_size': 1}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:18 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a 1073741824" returned: 0 in 0.661s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:18 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a
Apr 15 23:27:18 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (7d5b6106-349a-416b-8e01-8ed033cb9a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa910da0-0690-4d99-a580-c3fabc1c16e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa910da0-0690-4d99-a580-c3fabc1c16e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594616587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13451e89-e066-4f61-bc1f-445385301a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:19Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f83f8bf-93e4-4c2e-bd5f-9498014888e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f83f8bf-93e4-4c2e-bd5f-9498014888e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79d2659-d2b3-4c15-a66c-b7a627da5e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79d2659-d2b3-4c15-a66c-b7a627da5e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13451e89-e066-4f61-bc1f-445385301a87', 'volume_name': 'volume-13451e89-e066-4f61-bc1f-445385301a87', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e15de0-0907-45d9-9a32-64b5cac4df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e15de0-0907-45d9-9a32-64b5cac4df75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676aa15f-fb39-48ad-a903-383da6ebee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Volume 13451e89-e066-4f61-bc1f-445385301a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13451e89-e066-4f61-bc1f-445385301a87', 'volume_size': 1}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (b4fdfbf1-228f-4e54-af0c-ab977649e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e77edc-ccd0-4b88-bb8c-c83b9864f98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e77edc-ccd0-4b88-bb8c-c83b9864f98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-442586848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e0624a-0557-4b68-a1f3-87f360904b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:19Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18aa0fdf-fb3f-49b1-ad11-ab54ec400fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18aa0fdf-fb3f-49b1-ad11-ab54ec400fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53345029-c84e-47b4-a5e3-7576babbcf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53345029-c84e-47b4-a5e3-7576babbcf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e0624a-0557-4b68-a1f3-87f360904b1e', 'volume_name': 'volume-e1e0624a-0557-4b68-a1f3-87f360904b1e', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43df866f-a797-47ef-b860-01debec51c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43df866f-a797-47ef-b860-01debec51c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a9d560-4b0f-41c4-a9f8-94eec4d75cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:18 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Volume e1e0624a-0557-4b68-a1f3-87f360904b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e0624a-0557-4b68-a1f3-87f360904b1e', 'volume_size': 1}
Apr 15 23:27:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:19 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a" returned: 0 in 0.506s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139682875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42a67c9-7280-4820-bb2d-afef281a0f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Creating volume f42a67c9-7280-4820-bb2d-afef281a0f25 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:19 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5708df96-7762-48d7-a4c4-5487b48a333d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d836924b-5258-497e-8567-848ecbcc8b9a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35257b46-da76-4b8a-b925-8115343392fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:19 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25 1073741824
Apr 15 23:27:19 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:19 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Volume volume-d836924b-5258-497e-8567-848ecbcc8b9a (d836924b-5258-497e-8567-848ecbcc8b9a): created successfully
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35257b46-da76-4b8a-b925-8115343392fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Flow 'volume_create_manager' (7cb74775-ae3a-4c13-88d5-ef169d37d37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:19 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5d53edee-e04f-4119-aa8b-3bb892336670 tempest-VolumeDependencyTests-1245287785 None] Created volume successfully.
Apr 15 23:27:19 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25 1073741824" returned: 0 in 0.506s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:19 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25
Apr 15 23:27:19 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:20 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25" returned: 0 in 0.482s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.950s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-842215607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a743674-303f-4292-9521-83dd8e8148e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Creating volume 9a743674-303f-4292-9521-83dd8e8148e6 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:20 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae02eb0-4aa7-4082-8f57-b4eddea8bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42a67c9-7280-4820-bb2d-afef281a0f25', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624192f7-6dfe-4b76-9f29-45a572abe581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:20 devstack sudo[90065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6 1073741824
Apr 15 23:27:20 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:20 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Volume volume-f42a67c9-7280-4820-bb2d-afef281a0f25 (f42a67c9-7280-4820-bb2d-afef281a0f25): created successfully
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624192f7-6dfe-4b76-9f29-45a572abe581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (b7746de3-4e8e-4bcb-af9e-508f96951578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:20 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-78f634e4-d67f-4861-a0e0-644a4fce7499 tempest-CreateVolumesFromImageTest-743134449 None] Created volume successfully.
Apr 15 23:27:20 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6 1073741824" returned: 0 in 0.518s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:20 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:20 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6
Apr 15 23:27:20 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:21 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6" returned: 0 in 0.483s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.883s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1502016196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72220b30-8730-46c3-9ac6-5c2406304645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Creating volume 72220b30-8730-46c3-9ac6-5c2406304645 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:21 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0dcf9c-af8e-4019-8f99-a99b52d14b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a743674-303f-4292-9521-83dd8e8148e6', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:21 devstack sudo[90073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645 1073741824
Apr 15 23:27:21 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c705da-34db-465a-97f6-d9003a7d2a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:21 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume volume-9a743674-303f-4292-9521-83dd8e8148e6 (9a743674-303f-4292-9521-83dd8e8148e6): created successfully
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c705da-34db-465a-97f6-d9003a7d2a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (67af992c-9a9f-4202-8249-70e91ecac5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:21 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c36b87c4-5bb6-4f13-9016-e9c26a66a7bc tempest-CreateVolumesFromSnapshotTest-248631578 None] Created volume successfully.
Apr 15 23:27:21 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645 1073741824" returned: 0 in 0.567s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:21 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:21 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645
Apr 15 23:27:21 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:22 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645" returned: 0 in 0.539s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.781s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569799865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c51eb2-d322-4449-b5ce-194becf18cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:18Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Creating volume 00c51eb2-d322-4449-b5ce-194becf18cba {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:22 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9039b196-9792-475a-bfa1-f3c10a6118af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72220b30-8730-46c3-9ac6-5c2406304645', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9400350-13a8-44a9-9e43-87cc031a4e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:22 devstack sudo[90081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba 1073741824
Apr 15 23:27:22 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:22 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Volume volume-72220b30-8730-46c3-9ac6-5c2406304645 (72220b30-8730-46c3-9ac6-5c2406304645): created successfully
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9400350-13a8-44a9-9e43-87cc031a4e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (30f69c6a-9056-4c0c-892d-d9f4a0d24b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:22 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c962dcbd-b7fb-4782-ba1c-1df44c15e36b tempest-CreateVolumesFromImageTest-743134449 None] Created volume successfully.
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:22 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba 1073741824" returned: 0 in 0.616s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:22 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:22 devstack sudo[90086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba
Apr 15 23:27:22 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:23 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba" returned: 0 in 0.447s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.609s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594616587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13451e89-e066-4f61-bc1f-445385301a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:19Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Creating volume 13451e89-e066-4f61-bc1f-445385301a87 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:23 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c89dff-95e8-4991-a108-4b613747f8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c51eb2-d322-4449-b5ce-194becf18cba', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092bdb71-fbad-4bfc-a88f-ff9aed33add7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:23 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Volume volume-00c51eb2-d322-4449-b5ce-194becf18cba (00c51eb2-d322-4449-b5ce-194becf18cba): created successfully
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092bdb71-fbad-4bfc-a88f-ff9aed33add7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (0b9dd28b-1de3-4c5e-b295-d19fd13bc5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:23 devstack sudo[90089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87 1073741824
Apr 15 23:27:23 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:23 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d045499f-c8da-43b9-af2e-362612228a90 tempest-CreateVolumesFromImageTest-743134449 None] Created volume successfully.
Apr 15 23:27:23 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87 1073741824" returned: 0 in 0.582s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:23 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:24 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87
Apr 15 23:27:24 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:24 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87" returned: 0 in 0.460s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.566s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-442586848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e0624a-0557-4b68-a1f3-87f360904b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058e1cfd60ba481da84e835261479734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:19Z,use_quota=True,user_id='0e4f6c404ef94594bc824cda201eae4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Creating volume e1e0624a-0557-4b68-a1f3-87f360904b1e {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:24 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676aa15f-fb39-48ad-a903-383da6ebee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13451e89-e066-4f61-bc1f-445385301a87', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aedf2ca-cd8f-4c36-bc73-975bf1aeb0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:24 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e 1073741824
Apr 15 23:27:24 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:24 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Volume volume-13451e89-e066-4f61-bc1f-445385301a87 (13451e89-e066-4f61-bc1f-445385301a87): created successfully
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aedf2ca-cd8f-4c36-bc73-975bf1aeb0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:24 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (7d5b6106-349a-416b-8e01-8ed033cb9a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:24 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-7147424c-8b9c-468d-880f-74ec770ccdf4 tempest-CreateVolumesFromImageTest-743134449 None] Created volume successfully.
Apr 15 23:27:25 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e 1073741824" returned: 0 in 0.570s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:25 devstack sudo[90102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e
Apr 15 23:27:25 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:25 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.521s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Creating offline snapshot 9615707d-6df7-4f13-8592-bb520c8107a0 of volume d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a9d560-4b0f-41c4-a9f8-94eec4d75cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e0624a-0557-4b68-a1f3-87f360904b1e', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16e3781-0c26-4a3d-8ee3-dd923ffe8bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[5422b958-d8a6-4e63-a521-54c07cadb418]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:25 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Volume volume-e1e0624a-0557-4b68-a1f3-87f360904b1e (e1e0624a-0557-4b68-a1f3-87f360904b1e): created successfully
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16e3781-0c26-4a3d-8ee3-dd923ffe8bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:25 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Flow 'volume_create_manager' (b4fdfbf1-228f-4e54-af0c-ab977649e813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:25 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ed9c91fa-5435-4c9f-bdff-b5474316d33a tempest-CreateVolumesFromImageTest-743134449 None] Created volume successfully.
Apr 15 23:27:25 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a
Apr 15 23:27:25 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:26 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a" returned: 0 in 0.536s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:26 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 1G
Apr 15 23:27:26 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-e1e0624a-0557-4b68-a1f3-87f360904b1e-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-e1e0624a-0557-4b68-a1f3-87f360904b1e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-quobyte-e1e0624a-0557-4b68-a1f3-87f360904b1e" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-e1e0624a-0557-4b68-a1f3-87f360904b1e" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[120cc246-f8b1-4cc6-9efd-84fbed248658]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:26 devstack sudo[90116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e
Apr 15 23:27:26 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:26 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 1G" returned: 0 in 0.533s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:26 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d836924b-5258-497e-8567-848ecbcc8b9a -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:26 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d836924b-5258-497e-8567-848ecbcc8b9a -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0
Apr 15 23:27:26 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:27 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e" returned: 0 in 0.485s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:27 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e
Apr 15 23:27:27 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:27 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d836924b-5258-497e-8567-848ecbcc8b9a -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0" returned: 0 in 0.468s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:27 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 is being set with open permissions: ugo+rw
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:27 devstack sudo[90128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0
Apr 15 23:27:27 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:27 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e1e0624a-0557-4b68-a1f3-87f360904b1e" returned: 0 in 0.462s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-e1e0624a-0557-4b68-a1f3-87f360904b1e" released by "delete_volume" :: held 0.970s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Created reservations ['77aebc73-894c-4e0a-a555-f94ef09d2b89', '08986fd6-c859-448a-b353-7e1108026092', '82641076-ff32-49ca-88bc-994a88972317', '94d10a8e-0973-436d-819a-abd18f76ed7f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:27 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:27 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:27 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0" returned: 0 in 0.532s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:27 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:27 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.info
Apr 15 23:27:27 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:28 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.502s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Deleted volume successfully.
Apr 15 23:27:28 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.info" returned: 0 in 0.457s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:28 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.info is being set with open permissions: ugo+rw
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-b0560e67-90cd-42dd-b9f9-62e73cb2779b tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-e1e0624a-0557-4b68-a1f3-87f360904b1e-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:28 devstack sudo[90138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.info
Apr 15 23:27:28 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:28 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.info" returned: 0 in 0.407s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.094s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Creating offline snapshot feddead7-8cb7-4a42-a5be-276aae678dc0 of volume 9a743674-303f-4292-9521-83dd8e8148e6 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:27:28 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d123713e-5a0a-47bf-b29f-34925bb6f79f tempest-VolumeDependencyTests-1245287785 None] Create snapshot completed successfully
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebe9dbd-4167-4071-a2fb-9250f8cec3c0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:28 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6
Apr 15 23:27:28 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-13451e89-e066-4f61-bc1f-445385301a87-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-13451e89-e066-4f61-bc1f-445385301a87-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-quobyte-13451e89-e066-4f61-bc1f-445385301a87" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-13451e89-e066-4f61-bc1f-445385301a87" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c6d99-173b-4e71-a587-a99641a9044b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:28 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:28 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87
Apr 15 23:27:28 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:29 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6" returned: 0 in 0.654s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:29 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87" returned: 0 in 0.497s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:29 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 1G
Apr 15 23:27:29 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:29 devstack sudo[90153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87
Apr 15 23:27:29 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Flow 'volume_create_manager' (4e1b864b-76df-4bd9-a2d0-bf8cda223427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b17e7b3-87ae-4248-8e9b-8ba585e8e256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b17e7b3-87ae-4248-8e9b-8ba585e8e256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-454089852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6440cfa-1fe8-43d1-9b94-9ca3b13d8651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5029908c7f543a794058e529af72161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9615707d-6df7-4f13-8592-bb520c8107a0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:30Z,use_quota=True,user_id='4e33d0041ed74b26b18276d5f5a19488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b61a81-371f-4a06-93e3-4d37a4037495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b61a81-371f-4a06-93e3-4d37a4037495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d38a9e6-561b-496c-bebf-a8fb8aec8f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:29 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d38a9e6-561b-496c-bebf-a8fb8aec8f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6440cfa-1fe8-43d1-9b94-9ca3b13d8651', 'volume_name': 'volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651', 'volume_size': 1, 'snapshot_id': '9615707d-6df7-4f13-8592-bb520c8107a0'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412d453d-71a4-43c6-8428-b5de3f4b42a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412d453d-71a4-43c6-8428-b5de3f4b42a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827ba88d-9963-4492-a6bf-a2b8b88b287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:29 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Volume b6440cfa-1fe8-43d1-9b94-9ca3b13d8651: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651', 'volume_size': 1, 'snapshot_id': '9615707d-6df7-4f13-8592-bb520c8107a0'}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-13451e89-e066-4f61-bc1f-445385301a87" returned: 0 in 0.570s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-13451e89-e066-4f61-bc1f-445385301a87" released by "delete_volume" :: held 1.115s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:29 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 1G" returned: 0 in 0.643s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a743674-303f-4292-9521-83dd8e8148e6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:29 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a743674-303f-4292-9521-83dd8e8148e6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0
Apr 15 23:27:29 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Created reservations ['62ab01d9-38c5-4740-97c0-ebf1d4b7c854', '84281115-5c2e-4400-86b7-a6dbbab82edc', 'dd64886e-392f-4169-805b-b55b500a869b', '5c5eab11-0d7e-4499-bc2f-d11c39ea1b1a'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:29 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:29 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:29 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:30 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.387s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:30 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Deleted volume successfully.
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-d517bae2-bb6f-4b77-98f7-ae7ab05d126d tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-13451e89-e066-4f61-bc1f-445385301a87-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:30 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a743674-303f-4292-9521-83dd8e8148e6 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0" returned: 0 in 0.574s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:30 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 is being set with open permissions: ugo+rw
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:30 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0
Apr 15 23:27:30 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:30 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-00c51eb2-d322-4449-b5ce-194becf18cba-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0" returned: 0 in 0.488s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-00c51eb2-d322-4449-b5ce-194becf18cba-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:30 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:31 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.info
Apr 15 23:27:31 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-quobyte-00c51eb2-d322-4449-b5ce-194becf18cba" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:31 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-00c51eb2-d322-4449-b5ce-194becf18cba" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:31 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[08490168-576d-444f-997b-2ae51a6a4968]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:31 devstack sudo[90172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba
Apr 15 23:27:31 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:31 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.info" returned: 0 in 0.554s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:31 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.info is being set with open permissions: ugo+rw
Apr 15 23:27:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:31 devstack sudo[90178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.info
Apr 15 23:27:31 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:31 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba" returned: 0 in 0.546s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:31 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:31 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba
Apr 15 23:27:31 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:32 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Flow 'volume_create_manager' (7c788f48-66f8-4502-8f21-bc4d3c6fd206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b941c8a-2cd7-4c63-805c-87f7541876f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.info" returned: 0 in 0.603s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.629s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:32 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.336s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-9615707d-6df7-4f13-8592-bb520c8107a0-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" by "_create_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-00c51eb2-d322-4449-b5ce-194becf18cba" returned: 0 in 0.586s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b941c8a-2cd7-4c63-805c-87f7541876f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-526888829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f77fd8e-0f06-4822-b041-e8e6b6e26bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377cf55163f242c7b48c07185f213c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:32Z,use_quota=True,user_id='9d131a1f44cd4b398f4ac720f71d731f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6b2f34-1277-46ab-aed5-28f43b588f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6b2f34-1277-46ab-aed5-28f43b588f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0779e97-675c-42b1-8a65-1cd4ee37f694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0779e97-675c-42b1-8a65-1cd4ee37f694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f77fd8e-0f06-4822-b041-e8e6b6e26bc9', 'volume_name': 'volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36981bb-61ae-46f1-9db4-22f0f5e5d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36981bb-61ae-46f1-9db4-22f0f5e5d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad53525-9ce6-4398-bdbe-a22b90a779eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:32 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Volume 9f77fd8e-0f06-4822-b041-e8e6b6e26bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9', 'volume_size': 1}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-00c51eb2-d322-4449-b5ce-194becf18cba" released by "delete_volume" :: held 1.208s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-9615707d-6df7-4f13-8592-bb520c8107a0-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Creating volume b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 from snapshot 9615707d-6df7-4f13-8592-bb520c8107a0 {{(pid=81941) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:32 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-44cb745d-4c7e-44a3-9a14-c744e21a811b tempest-CreateVolumesFromSnapshotTest-248631578 None] Create snapshot completed successfully
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] snapshot: 9615707d-6df7-4f13-8592-bb520c8107a0, volume: b6440cfa-1fe8-43d1-9b94-9ca3b13d8651,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d497e6-9443-466c-b192-d4c118e49fc2]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Created reservations ['8994edb1-4eee-474e-90ba-a39309f04f18', 'd958dc9e-e480-4a65-86e6-2a7d6273387c', 'd5c38e45-a20b-4e95-8d13-1144b8c24b5d', '23f19414-20ba-4d0b-b28c-8abcde268669'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:32 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0
Apr 15 23:27:32 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:32 devstack sudo[90192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:32 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:32 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.424s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:32 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Deleted volume successfully.
Apr 15 23:27:32 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0" returned: 0 in 0.521s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d836924b-5258-497e-8567-848ecbcc8b9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcda3d5-b0d8-4f7f-8b03-3e6a8b52a2e4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:32 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-6cd52f8c-d2e0-435d-bc01-e7ee34d56acd tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-00c51eb2-d322-4449-b5ce-194becf18cba-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:32 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a
Apr 15 23:27:32 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (ccf829d2-7637-402a-9461-7e98143c1212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf428c4-04d2-4537-b3ff-e23f39b71bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf428c4-04d2-4537-b3ff-e23f39b71bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-224044769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8700ec72-e352-4770-875c-5ed7fb8f7823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:33Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a98dc2-2133-40f6-bf35-e178ac036a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a98dc2-2133-40f6-bf35-e178ac036a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4098345f-2eaf-47eb-8562-474700323223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4098345f-2eaf-47eb-8562-474700323223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8700ec72-e352-4770-875c-5ed7fb8f7823', 'volume_name': 'volume-8700ec72-e352-4770-875c-5ed7fb8f7823', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbbd21a-2789-4bdd-8ccd-6ca7c8b5d43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbbd21a-2789-4bdd-8ccd-6ca7c8b5d43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d329af49-73b0-434a-ad19-55d287cd7753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume 8700ec72-e352-4770-875c-5ed7fb8f7823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8700ec72-e352-4770-875c-5ed7fb8f7823', 'volume_size': 1}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-72220b30-8730-46c3-9ac6-5c2406304645-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-72220b30-8730-46c3-9ac6-5c2406304645-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-quobyte-72220b30-8730-46c3-9ac6-5c2406304645" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-72220b30-8730-46c3-9ac6-5c2406304645" acquired by "delete_volume" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eae8a1e-ec25-4b05-82cb-77929181205c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (f89dde63-9fbc-4e37-bb43-140a28520855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f1b124-0e32-47fa-ab96-9b07ea0c1c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f1b124-0e32-47fa-ab96-9b07ea0c1c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1836568007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665d1a87-242d-4219-a811-3b6c5df58b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:33Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d8e15e-d807-4384-acbb-548fc4dd12bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d8e15e-d807-4384-acbb-548fc4dd12bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c61b13-2227-466f-a76f-544fd5dda62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c61b13-2227-466f-a76f-544fd5dda62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665d1a87-242d-4219-a811-3b6c5df58b02', 'volume_name': 'volume-665d1a87-242d-4219-a811-3b6c5df58b02', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645
Apr 15 23:27:33 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdadb73a-e225-4b81-bd51-f7829cd2092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdadb73a-e225-4b81-bd51-f7829cd2092d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2eda8fa-b156-46b7-91d7-f1fd7fa187e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume 665d1a87-242d-4219-a811-3b6c5df58b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665d1a87-242d-4219-a811-3b6c5df58b02', 'volume_size': 1}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (42501011-16d8-40e4-a4b0-680302fded5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde7f968-edec-460f-bca3-1435cc27d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde7f968-edec-460f-bca3-1435cc27d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145320972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4a21ea-7c90-4568-8da2-10ad7be3dd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:33Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ac99ad-4aef-4ce3-9c0c-618c39c7e0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ac99ad-4aef-4ce3-9c0c-618c39c7e0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cbe6e9-51a1-4348-9033-60f47a800d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cbe6e9-51a1-4348-9033-60f47a800d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4a21ea-7c90-4568-8da2-10ad7be3dd2c', 'volume_name': 'volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99357faa-8777-42a0-be4b-6862e5b0a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99357faa-8777-42a0-be4b-6862e5b0a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27335b8f-1d58-4385-9517-e669b93a6095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume 2b4a21ea-7c90-4568-8da2-10ad7be3dd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c', 'volume_size': 1}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a" returned: 0 in 0.698s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:33 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651
Apr 15 23:27:33 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (19a26338-a183-4c61-8f8e-a6a2490a0d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5496823-0810-40c5-9c2d-95adf6468489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5496823-0810-40c5-9c2d-95adf6468489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595939006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f4942e-e134-4a23-a45d-2b00ba88538d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:34Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0708a73c-fdd8-4569-83fa-6865e22b996b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0708a73c-fdd8-4569-83fa-6865e22b996b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1189181f-35a5-40e9-bc76-bd15d20d6d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1189181f-35a5-40e9-bc76-bd15d20d6d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f4942e-e134-4a23-a45d-2b00ba88538d', 'volume_name': 'volume-68f4942e-e134-4a23-a45d-2b00ba88538d', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b6350f-a286-424c-936e-d28025444603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b6350f-a286-424c-936e-d28025444603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae79710-3d98-48ca-89f5-9cb3f67b7a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume 68f4942e-e134-4a23-a45d-2b00ba88538d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f4942e-e134-4a23-a45d-2b00ba88538d', 'volume_size': 1}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:33 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645" returned: 0 in 0.568s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:33 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645
Apr 15 23:27:33 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (9546c0cb-8f10-462c-9fb3-8fb279d6d108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ec5162-f35f-4844-a964-1a2e207f1fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ec5162-f35f-4844-a964-1a2e207f1fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820356359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25eca283-67c4-486d-bb79-8b46ce31d327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:34Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f722cfa9-3525-414b-9ef1-6253210b4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f722cfa9-3525-414b-9ef1-6253210b4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b94171b-f414-4040-b90c-042d8eae4f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b94171b-f414-4040-b90c-042d8eae4f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25eca283-67c4-486d-bb79-8b46ce31d327', 'volume_name': 'volume-25eca283-67c4-486d-bb79-8b46ce31d327', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c93f73-be06-43db-aec7-dd29830ab02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c93f73-be06-43db-aec7-dd29830ab02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4b51e9-3817-4c7a-b303-9142ea2d91c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:33 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume 25eca283-67c4-486d-bb79-8b46ce31d327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25eca283-67c4-486d-bb79-8b46ce31d327', 'volume_size': 1}
Apr 15 23:27:33 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:34 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-72220b30-8730-46c3-9ac6-5c2406304645" returned: 0 in 0.882s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:34 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-72220b30-8730-46c3-9ac6-5c2406304645" released by "delete_volume" :: held 1.482s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:34 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Created reservations ['981c9de9-ce10-4217-9862-e10c238d7e42', 'c8199929-78d9-4743-8a95-33213a76e4d4', 'b1613846-669d-43ab-922e-d36e2f1b15fb', 'af64fe5f-2bc4-42f0-bf0f-0dd545b180c0'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:34 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:34 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:35 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:35 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-f42a67c9-7280-4820-bb2d-afef281a0f25-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-f42a67c9-7280-4820-bb2d-afef281a0f25-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "cinder-quobyte-f42a67c9-7280-4820-bb2d-afef281a0f25" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-f42a67c9-7280-4820-bb2d-afef281a0f25" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f7daf-97c4-47be-9678-777634b496db]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:35 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" returned: 0 in 2.303s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d515c7a3-4177-4271-9248-a6c503d3ce21]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:35 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25
Apr 15 23:27:35 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:35 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.904s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:35 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Deleted volume successfully.
Apr 15 23:27:35 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5567f97-23e8-4228-89e3-d9921f70a020 tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-72220b30-8730-46c3-9ac6-5c2406304645-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:35 devstack sudo[90228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a
Apr 15 23:27:35 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:36 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25" returned: 0 in 0.499s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:36 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25
Apr 15 23:27:36 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:36 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a" returned: 0 in 0.594s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:27:36 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Converted 1024.00 MB image at 444.33 MB/s
Apr 15 23:27:36 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 is being set with open permissions: ugo+rw
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:36 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651
Apr 15 23:27:36 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:36 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-f42a67c9-7280-4820-bb2d-afef281a0f25" returned: 0 in 0.401s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-quobyte-f42a67c9-7280-4820-bb2d-afef281a0f25" released by "delete_volume" :: held 0.928s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Created reservations ['7401a96d-fb50-42f3-8bd4-d2acf2892cc6', '1df0a197-14fc-49a8-9001-e21e350812cf', '73c8f944-b2a8-4f12-a596-55b309f822f1', '6cfeffd6-54e3-4278-ae5e-0e0d354febde'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:36 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:36 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:36 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" released by "_copy_volume_from_snapshot" :: held 4.635s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-9615707d-6df7-4f13-8592-bb520c8107a0-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" released by "_create_volume_from_snapshot" :: held 4.665s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.738s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.690s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-526888829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f77fd8e-0f06-4822-b041-e8e6b6e26bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377cf55163f242c7b48c07185f213c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:32Z,use_quota=True,user_id='9d131a1f44cd4b398f4ac720f71d731f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Creating volume 9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:36 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:36 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 1073741824
Apr 15 23:27:36 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827ba88d-9963-4492-a6bf-a2b8b88b287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651', 'volume_size': 1, 'snapshot_id': '9615707d-6df7-4f13-8592-bb520c8107a0'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852fe087-3fc6-48ee-b7ea-e37d88a72f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:36 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Volume volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 (b6440cfa-1fe8-43d1-9b94-9ca3b13d8651): created successfully
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852fe087-3fc6-48ee-b7ea-e37d88a72f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:36 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Flow 'volume_create_manager' (4e1b864b-76df-4bd9-a2d0-bf8cda223427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:36 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-da74a6e5-4562-4d2f-a18d-8957958c26b0 tempest-VolumeDependencyTests-1245287785 None] Created volume successfully.
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-9615707d-6df7-4f13-8592-bb520c8107a0-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-9615707d-6df7-4f13-8592-bb520c8107a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-d836924b-5258-497e-8567-848ecbcc8b9a" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-d836924b-5258-497e-8567-848ecbcc8b9a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-9615707d-6df7-4f13-8592-bb520c8107a0" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-9615707d-6df7-4f13-8592-bb520c8107a0" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Deleting offline snapshot 9615707d-6df7-4f13-8592-bb520c8107a0 of volume d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] snapshot_file for this snap is: volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[538107aa-9624-4c32-b6c8-b7f206b14f04]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:37 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:37 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Deleted volume successfully.
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-501af21c-81c5-4868-b7a9-ec276d3b2ad2 tempest-CreateVolumesFromImageTest-743134449 None] Lock "cinder-f42a67c9-7280-4820-bb2d-afef281a0f25-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:37 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0
Apr 15 23:27:37 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:37 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 1073741824" returned: 0 in 0.576s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:37 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9
Apr 15 23:27:37 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:37 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0" returned: 0 in 0.599s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d836924b-5258-497e-8567-848ecbcc8b9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[823574d9-1190-4add-aa25-91adaea3bd26]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:37 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a
Apr 15 23:27:37 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:38 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" returned: 0 in 0.498s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.926s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-224044769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8700ec72-e352-4770-875c-5ed7fb8f7823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:33Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Creating volume 8700ec72-e352-4770-875c-5ed7fb8f7823 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:38 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad53525-9ce6-4398-bdbe-a22b90a779eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:38 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823 1073741824
Apr 15 23:27:38 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2271fd9e-a53f-44d6-9055-10a8f6654581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:38 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Volume volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 (9f77fd8e-0f06-4822-b041-e8e6b6e26bc9): created successfully
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2271fd9e-a53f-44d6-9055-10a8f6654581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Flow 'volume_create_manager' (7c788f48-66f8-4502-8f21-bc4d3c6fd206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-bb1d96f6-52b1-411e-970c-23aa5848dd43 tempest-SnapshotDependencyTests-608744464 None] Created volume successfully.
Apr 15 23:27:38 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a" returned: 0 in 0.562s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:38 devstack sudo[90266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0
Apr 15 23:27:38 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:38 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823 1073741824" returned: 0 in 0.589s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:38 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823
Apr 15 23:27:38 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (2206a8d7-e1c6-4c3a-92cb-fb206d41c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc0c2f4-bfa0-43f6-b088-b4f160a35f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc0c2f4-bfa0-43f6-b088-b4f160a35f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1244616730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1774301-b8c5-40bc-8172-a6ed64dd00d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:39Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4e2de0-2776-4cbf-a135-ce6f58077717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4e2de0-2776-4cbf-a135-ce6f58077717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72570c94-a391-4cf7-947f-c87cf9b9c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72570c94-a391-4cf7-947f-c87cf9b9c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1774301-b8c5-40bc-8172-a6ed64dd00d5', 'volume_name': 'volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd38d491-f220-4994-b72d-1824a032317f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd38d491-f220-4994-b72d-1824a032317f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ba4f4a-5d43-4067-8e11-ea0f53cf35b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:38 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume b1774301-b8c5-40bc-8172-a6ed64dd00d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5', 'volume_size': 1}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:38 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0" returned: 0 in 0.605s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:38 devstack sudo[90276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0
Apr 15 23:27:39 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:39 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823" returned: 0 in 0.559s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.878s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1836568007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665d1a87-242d-4219-a811-3b6c5df58b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:33Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Creating volume 665d1a87-242d-4219-a811-3b6c5df58b02 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:39 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d329af49-73b0-434a-ad19-55d287cd7753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8700ec72-e352-4770-875c-5ed7fb8f7823', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e83832-05ba-483b-a9d7-35e4f20cae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:39 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02 1073741824
Apr 15 23:27:39 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:39 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume volume-8700ec72-e352-4770-875c-5ed7fb8f7823 (8700ec72-e352-4770-875c-5ed7fb8f7823): created successfully
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e83832-05ba-483b-a9d7-35e4f20cae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (ccf829d2-7637-402a-9461-7e98143c1212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:39 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-ec0884db-4364-4b04-bb70-95c34649035e tempest-CreateVolumesFromSnapshotTest-248631578 None] Created volume successfully.
Apr 15 23:27:39 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a.9615707d-6df7-4f13-8592-bb520c8107a0" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-9615707d-6df7-4f13-8592-bb520c8107a0" released by "_delete_snapshot" :: held 2.304s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-d836924b-5258-497e-8567-848ecbcc8b9a" released by "delete_snapshot" :: held 2.318s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Created reservations ['7c6dadec-d783-4f2f-99ce-14d756be1bb0', '57bf72ae-f74e-44e0-a02d-8a9f44de5ac6', 'e09ec74b-5148-4dca-b7cc-f3f2e826316a', '69051f49-7043-48f5-9472-51bed6e89566'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:39 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Delete snapshot completed successfully.
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c8efd2f5-649c-47f5-badd-8fa956d1b27e tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-9615707d-6df7-4f13-8592-bb520c8107a0-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:39 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02 1073741824" returned: 0 in 0.513s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:39 devstack sudo[90285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02
Apr 15 23:27:39 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:40 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02" returned: 0 in 0.407s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.623s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145320972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4a21ea-7c90-4568-8da2-10ad7be3dd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:33Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Creating volume 2b4a21ea-7c90-4568-8da2-10ad7be3dd2c {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:40 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2eda8fa-b156-46b7-91d7-f1fd7fa187e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665d1a87-242d-4219-a811-3b6c5df58b02', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b113d88d-12a9-46c8-9458-620989224ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:40 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c 1073741824
Apr 15 23:27:40 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:40 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume volume-665d1a87-242d-4219-a811-3b6c5df58b02 (665d1a87-242d-4219-a811-3b6c5df58b02): created successfully
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b113d88d-12a9-46c8-9458-620989224ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (f89dde63-9fbc-4e37-bb43-140a28520855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:40 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-32d3387d-5fd5-40ef-85ec-71082b4eb4b2 tempest-CreateVolumesFromSnapshotTest-248631578 None] Created volume successfully.
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-d836924b-5258-497e-8567-848ecbcc8b9a-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-d836924b-5258-497e-8567-848ecbcc8b9a-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-d836924b-5258-497e-8567-848ecbcc8b9a" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-d836924b-5258-497e-8567-848ecbcc8b9a" acquired by "delete_volume" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[0128ead6-1ae7-435a-85a6-2da26533dd5f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:40 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a
Apr 15 23:27:40 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:40 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c 1073741824" returned: 0 in 0.509s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:40 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c
Apr 15 23:27:40 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:40 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a" returned: 0 in 0.494s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:40 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:40 devstack sudo[90300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a
Apr 15 23:27:40 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:41 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c" returned: 0 in 0.437s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.403s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595939006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f4942e-e134-4a23-a45d-2b00ba88538d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:34Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Creating volume 68f4942e-e134-4a23-a45d-2b00ba88538d {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:41 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27335b8f-1d58-4385-9517-e669b93a6095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974743c3-235b-43da-afad-5bf4a42d3c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:41 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d 1073741824
Apr 15 23:27:41 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c (2b4a21ea-7c90-4568-8da2-10ad7be3dd2c): created successfully
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974743c3-235b-43da-afad-5bf4a42d3c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (42501011-16d8-40e4-a4b0-680302fded5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3cd254a8-f29a-4c67-b0ce-c37877a1788b tempest-CreateVolumesFromSnapshotTest-248631578 None] Created volume successfully.
Apr 15 23:27:41 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-d836924b-5258-497e-8567-848ecbcc8b9a" returned: 0 in 0.422s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-d836924b-5258-497e-8567-848ecbcc8b9a" released by "delete_volume" :: held 0.961s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Created reservations ['930f490c-ac71-483f-8754-33cc74fbc727', '03a79ec3-f504-460b-b767-cb7708636656', '4b656b41-519c-4b88-8ca3-fb01a3402c60', '8998cfcb-81e7-450e-8cc4-9677ee27599f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:41 devstack sudo[90306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:41 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Flow 'volume_create_manager' (d6e4506f-2c68-4444-9235-8d149140447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e976bf73-527f-451b-987b-43c57b03cbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e976bf73-527f-451b-987b-43c57b03cbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-942140034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4f0b68-dac3-4043-8a22-d74f7d324d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5029908c7f543a794058e529af72161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:42Z,use_quota=True,user_id='4e33d0041ed74b26b18276d5f5a19488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da53cd9-b453-48f1-b5f8-8b29206fdc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da53cd9-b453-48f1-b5f8-8b29206fdc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5ec6ee-e754-4d0d-8063-77d194523bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5ec6ee-e754-4d0d-8063-77d194523bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4f0b68-dac3-4043-8a22-d74f7d324d39', 'volume_name': 'volume-da4f0b68-dac3-4043-8a22-d74f7d324d39', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf421baf-6ffd-4d36-8a47-8cb0cea26ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf421baf-6ffd-4d36-8a47-8cb0cea26ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31137cd5-b34b-4085-b06e-3c26e830af96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:41 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Volume da4f0b68-dac3-4043-8a22-d74f7d324d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4f0b68-dac3-4043-8a22-d74f7d324d39', 'volume_size': 1}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:41 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d 1073741824" returned: 0 in 0.584s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:41 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d
Apr 15 23:27:41 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:41 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.486s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:41 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Deleted volume successfully.
Apr 15 23:27:41 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-f5ff7045-1397-4396-9cac-a487ddc6cbdd tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-d836924b-5258-497e-8567-848ecbcc8b9a-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:42 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d" returned: 0 in 0.432s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.220s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820356359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25eca283-67c4-486d-bb79-8b46ce31d327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ace2c6373142e6bf27224038dcb2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:34Z,use_quota=True,user_id='3399af9a98014c81b39c9b6c84ccc7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Creating volume 25eca283-67c4-486d-bb79-8b46ce31d327 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:42 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae79710-3d98-48ca-89f5-9cb3f67b7a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f4942e-e134-4a23-a45d-2b00ba88538d', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:42 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327 1073741824
Apr 15 23:27:42 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5ea7f3-43e1-438d-9791-e64ea16ce66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:42 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume volume-68f4942e-e134-4a23-a45d-2b00ba88538d (68f4942e-e134-4a23-a45d-2b00ba88538d): created successfully
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5ea7f3-43e1-438d-9791-e64ea16ce66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (19a26338-a183-4c61-8f8e-a6a2490a0d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:42 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0e68d996-d1d9-4068-a967-90775a61658a tempest-CreateVolumesFromSnapshotTest-248631578 None] Created volume successfully.
Apr 15 23:27:42 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327 1073741824" returned: 0 in 0.470s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:42 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327
Apr 15 23:27:42 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:43 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327" returned: 0 in 0.420s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.233s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1244616730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1774301-b8c5-40bc-8172-a6ed64dd00d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:39Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Creating volume b1774301-b8c5-40bc-8172-a6ed64dd00d5 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:43 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4b51e9-3817-4c7a-b303-9142ea2d91c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25eca283-67c4-486d-bb79-8b46ce31d327', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2001be-87dc-4223-a29b-dc1fe0a297b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:43 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5 1073741824
Apr 15 23:27:43 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:43 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Volume volume-25eca283-67c4-486d-bb79-8b46ce31d327 (25eca283-67c4-486d-bb79-8b46ce31d327): created successfully
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2001be-87dc-4223-a29b-dc1fe0a297b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Flow 'volume_create_manager' (9546c0cb-8f10-462c-9fb3-8fb279d6d108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:43 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cfef2029-f516-437c-a309-e5380644b133 tempest-CreateVolumesFromSnapshotTest-248631578 None] Created volume successfully.
Apr 15 23:27:43 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5 1073741824" returned: 0 in 0.480s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-25eca283-67c4-486d-bb79-8b46ce31d327-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:43 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5
Apr 15 23:27:43 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-25eca283-67c4-486d-bb79-8b46ce31d327-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-quobyte-25eca283-67c4-486d-bb79-8b46ce31d327" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-25eca283-67c4-486d-bb79-8b46ce31d327" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0beac6-42c6-4f63-a3ea-ec2b548da3a9]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:43 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:43 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327
Apr 15 23:27:43 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:44 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5" returned: 0 in 0.431s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.026s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ba4f4a-5d43-4067-8e11-ea0f53cf35b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7502709f-e876-488e-b9db-72f39927264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Creating offline snapshot 130a4254-b3c5-4b0f-b425-67344c726200 of volume 9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:27:44 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5 (b1774301-b8c5-40bc-8172-a6ed64dd00d5): created successfully
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7502709f-e876-488e-b9db-72f39927264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (2206a8d7-e1c6-4c3a-92cb-fb206d41c580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c471d203-91a0-4976-b788-a635911a3ef5]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:44 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a73ddf92-4b0a-46af-8bd5-609d22721af2 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created volume successfully.
Apr 15 23:27:44 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9
Apr 15 23:27:44 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:44 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327" returned: 0 in 0.485s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:44 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327
Apr 15 23:27:44 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:44 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" returned: 0 in 0.500s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:44 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-25eca283-67c4-486d-bb79-8b46ce31d327" returned: 0 in 0.401s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-25eca283-67c4-486d-bb79-8b46ce31d327" released by "delete_volume" :: held 0.927s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:44 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 1G
Apr 15 23:27:44 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Created reservations ['c27aef90-24f4-4a4f-9a38-e34a1091c02a', 'cca69d0c-80cb-4a6b-a33a-96b7ca888b4a', '4846bdb4-c32b-471f-b8cf-5b3144eb51e0', '25588b06-7c98-4b17-9f7a-8d5d87487af2'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:44 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:44 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-68f4942e-e134-4a23-a45d-2b00ba88538d-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-68f4942e-e134-4a23-a45d-2b00ba88538d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-quobyte-68f4942e-e134-4a23-a45d-2b00ba88538d" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-68f4942e-e134-4a23-a45d-2b00ba88538d" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee40510-ad36-462d-b234-0c4bea364421]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:44 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:44 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d
Apr 15 23:27:44 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:45 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 1G" returned: 0 in 0.533s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:45 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200
Apr 15 23:27:45 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:45 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.498s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:45 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Deleted volume successfully.
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-1d8d7ca3-5b98-43ff-87c6-4f5ddd5b0910 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-25eca283-67c4-486d-bb79-8b46ce31d327-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (414ac3d3-347a-4370-9f07-9f0ec9212e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2898f2b-c765-4de0-a49c-bba7eddde30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2898f2b-c765-4de0-a49c-bba7eddde30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221336267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fda7a52-6d66-41fc-b112-e2e16b7e81fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:45Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd6a7ec-0634-4750-ba00-ae672ac1e5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd6a7ec-0634-4750-ba00-ae672ac1e5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dd6162-99c1-43b4-89c9-63f57b230659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dd6162-99c1-43b4-89c9-63f57b230659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fda7a52-6d66-41fc-b112-e2e16b7e81fa', 'volume_name': 'volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01ff9ab-ce2a-44ed-ab57-b6267105026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01ff9ab-ce2a-44ed-ab57-b6267105026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7ac547-03bc-42a5-b3fa-560f8922c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume 9fda7a52-6d66-41fc-b112-e2e16b7e81fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa', 'volume_size': 1}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:45 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d" returned: 0 in 0.625s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:45 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d
Apr 15 23:27:45 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (9a036c66-d307-4352-b7a0-c2e121d00c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda4e26b-be81-4b0d-b425-4c6dfc3605a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda4e26b-be81-4b0d-b425-4c6dfc3605a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259388086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2aa2677-a028-4688-a445-f6fed7b56125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:46Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cedd230-bb71-44a4-893f-09e8395a3afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cedd230-bb71-44a4-893f-09e8395a3afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2270fda4-5d2a-4c53-9d84-a3a7c0a2f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2270fda4-5d2a-4c53-9d84-a3a7c0a2f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2aa2677-a028-4688-a445-f6fed7b56125', 'volume_name': 'volume-e2aa2677-a028-4688-a445-f6fed7b56125', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c6c85e-174a-4168-9e64-eb7cfbdb32fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c6c85e-174a-4168-9e64-eb7cfbdb32fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6704f6be-44fd-4497-b629-8a4c64a7be6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume e2aa2677-a028-4688-a445-f6fed7b56125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2aa2677-a028-4688-a445-f6fed7b56125', 'volume_size': 1}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:45 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200" returned: 0 in 0.553s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:45 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 is being set with open permissions: ugo+rw
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:45 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200
Apr 15 23:27:45 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (c89d9e19-b3d1-4ba9-b639-46a8961a851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d60b863-f93f-4c95-8dd0-e2480255be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d60b863-f93f-4c95-8dd0-e2480255be57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1938189442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9faf1312-03fb-44b2-8fc4-e97ffb4d411f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:46Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b6321c-83d7-4548-b9eb-95a781fb18cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b6321c-83d7-4548-b9eb-95a781fb18cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a345666-33ec-4573-b00b-327b8d701f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a345666-33ec-4573-b00b-327b8d701f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9faf1312-03fb-44b2-8fc4-e97ffb4d411f', 'volume_name': 'volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b411422-e918-4ac0-a137-72668da03164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b411422-e918-4ac0-a137-72668da03164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b2fb21-d3c4-40b0-ad4b-9ff188179ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:45 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume 9faf1312-03fb-44b2-8fc4-e97ffb4d411f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f', 'volume_size': 1}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:45 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (cdab2965-8d1b-4a8c-90a5-8f2703a55656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a08f84-9183-4e2a-a365-c9cec2197b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a08f84-9183-4e2a-a365-c9cec2197b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1090471624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92901248-ef86-44ca-b370-bcc0ca5def3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:46Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4c382e-ef84-44c6-8888-e46e56555090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4c382e-ef84-44c6-8888-e46e56555090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8736ff47-f92c-49a6-8e6b-d99291c383c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8736ff47-f92c-49a6-8e6b-d99291c383c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92901248-ef86-44ca-b370-bcc0ca5def3a', 'volume_name': 'volume-92901248-ef86-44ca-b370-bcc0ca5def3a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce0505-7045-4d30-90c3-672d1162750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce0505-7045-4d30-90c3-672d1162750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270aad66-c032-48a4-bbc1-51d8acac297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume 92901248-ef86-44ca-b370-bcc0ca5def3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92901248-ef86-44ca-b370-bcc0ca5def3a', 'volume_size': 1}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:46 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-68f4942e-e134-4a23-a45d-2b00ba88538d" returned: 0 in 0.620s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-68f4942e-e134-4a23-a45d-2b00ba88538d" released by "delete_volume" :: held 1.276s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Created reservations ['9cf7c268-d324-4a1d-bb88-7dec36ebb285', 'dc46fa8e-217c-4c2e-880c-29d10eb1e153', '75f89ae4-9abe-4416-a3b6-59e785826376', '8b0f7dc7-0b12-4e4c-aa6d-1394e38ede25'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (db954ee6-6690-499b-9df6-97914f775744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1662709d-994e-4202-9a2c-c29aa0214c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1662709d-994e-4202-9a2c-c29aa0214c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767127462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b988c3-cb9e-433d-8a8d-fc74dd00072c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:46Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b656faa-4aae-49a0-8027-d81169b319fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b656faa-4aae-49a0-8027-d81169b319fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a4d87a-a53d-48ee-90d8-cf594673baba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a4d87a-a53d-48ee-90d8-cf594673baba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b988c3-cb9e-433d-8a8d-fc74dd00072c', 'volume_name': 'volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630fceb7-84be-4f3b-bacf-c17ea291b5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630fceb7-84be-4f3b-bacf-c17ea291b5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0033935-0485-4c2a-bc43-c07af80a8e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:46 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume 59b988c3-cb9e-433d-8a8d-fc74dd00072c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c', 'volume_size': 1}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:46 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200" returned: 0 in 0.576s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:46 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:46 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:46 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.info
Apr 15 23:27:46 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:46 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.397s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:46 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Deleted volume successfully.
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-9a48e5d9-9646-43e5-ae80-4e2ebec0f33b tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-68f4942e-e134-4a23-a45d-2b00ba88538d-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:46 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.info" returned: 0 in 0.428s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:46 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.info is being set with open permissions: ugo+rw
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:46 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.info
Apr 15 23:27:46 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-quobyte-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:46 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad33b619-4710-422a-90b1-dff3bd86e211]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:47 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c
Apr 15 23:27:47 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:47 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.info" returned: 0 in 0.432s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.112s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.452s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-942140034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4f0b68-dac3-4043-8a22-d74f7d324d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5029908c7f543a794058e529af72161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:42Z,use_quota=True,user_id='4e33d0041ed74b26b18276d5f5a19488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Creating volume da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:47 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:47 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c4c27022-1979-4821-b283-873a2531f733 tempest-SnapshotDependencyTests-608744464 None] Create snapshot completed successfully
Apr 15 23:27:47 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 1073741824
Apr 15 23:27:47 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:47 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c" returned: 0 in 0.462s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:47 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c
Apr 15 23:27:47 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:47 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 1073741824" returned: 0 in 0.522s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:47 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39
Apr 15 23:27:47 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:47 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c" returned: 0 in 0.408s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c" released by "delete_volume" :: held 0.898s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Created reservations ['09617a3a-1c03-4983-8da1-050de513c52e', '83ab5499-f7f0-485b-93bc-6b4bb61621bd', '3b6e23c6-94cc-4b16-81fe-f0bce6300442', '27a48beb-ead7-4a1b-950c-37522b1ac5dc'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:47 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:47 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-665d1a87-242d-4219-a811-3b6c5df58b02-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-665d1a87-242d-4219-a811-3b6c5df58b02-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-quobyte-665d1a87-242d-4219-a811-3b6c5df58b02" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-665d1a87-242d-4219-a811-3b6c5df58b02" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ddac29-1c3a-4874-bc14-0b36a42774d4]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:48 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02
Apr 15 23:27:48 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:48 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39" returned: 0 in 0.472s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.801s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221336267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fda7a52-6d66-41fc-b112-e2e16b7e81fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:45Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Creating volume 9fda7a52-6d66-41fc-b112-e2e16b7e81fa {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:48 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31137cd5-b34b-4085-b06e-3c26e830af96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4f0b68-dac3-4043-8a22-d74f7d324d39', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3ded70-7100-44ea-a5d2-aba50764bb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:48 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa 1073741824
Apr 15 23:27:48 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:48 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Volume volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 (da4f0b68-dac3-4043-8a22-d74f7d324d39): created successfully
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3ded70-7100-44ea-a5d2-aba50764bb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Flow 'volume_create_manager' (d6e4506f-2c68-4444-9235-8d149140447c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:48 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b48a18c4-474c-43b3-86ea-b278e4fe01e9 tempest-VolumeDependencyTests-1245287785 None] Created volume successfully.
Apr 15 23:27:48 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.502s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:48 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Deleted volume successfully.
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-37991be2-c772-4744-a77e-b986ccfe3679 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-2b4a21ea-7c90-4568-8da2-10ad7be3dd2c-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Flow 'volume_create_manager' (ccf19dd4-cb57-46ad-a2ff-49a262472171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:48 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1608ee43-4822-4b9a-9a19-17bcc121ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02" returned: 0 in 0.536s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:48 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02
Apr 15 23:27:48 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1608ee43-4822-4b9a-9a19-17bcc121ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35298433-be77-4de9-b027-228af898b354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377cf55163f242c7b48c07185f213c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=130a4254-b3c5-4b0f-b425-67344c726200,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:49Z,use_quota=True,user_id='9d131a1f44cd4b398f4ac720f71d731f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad3a43c-17f5-47d4-97e6-fc2dd46152fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad3a43c-17f5-47d4-97e6-fc2dd46152fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217e9289-a90d-4f4f-a014-909bd6dbd09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217e9289-a90d-4f4f-a014-909bd6dbd09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35298433-be77-4de9-b027-228af898b354', 'volume_name': 'volume-35298433-be77-4de9-b027-228af898b354', 'volume_size': 1, 'snapshot_id': '130a4254-b3c5-4b0f-b425-67344c726200'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63abae4-bb87-46ea-91e7-078a494ccfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63abae4-bb87-46ea-91e7-078a494ccfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6b9e26-b4b0-41b2-b8f3-b6c0331fa5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:48 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Volume 35298433-be77-4de9-b027-228af898b354: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35298433-be77-4de9-b027-228af898b354', 'volume_size': 1, 'snapshot_id': '130a4254-b3c5-4b0f-b425-67344c726200'}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:48 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa 1073741824" returned: 0 in 0.654s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:48 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:48 devstack sudo[90444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa
Apr 15 23:27:48 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:49 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-665d1a87-242d-4219-a811-3b6c5df58b02" returned: 0 in 0.472s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-665d1a87-242d-4219-a811-3b6c5df58b02" released by "delete_volume" :: held 1.034s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Created reservations ['cbc050f9-fd14-4823-8f0a-5b35ea2f625c', 'bd3b3cfc-5563-4723-80fa-817f7f98f119', '620c6398-a7b4-4444-ab37-ee7ddafa6505', '875d0cd2-9e70-4590-ba48-dd78817117d5'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:49 devstack sudo[90447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:49 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Flow 'volume_create_manager' (3f78b93c-b58d-475e-a76f-65332c73eefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3366a5-3677-4027-b6d5-27558dd7b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3366a5-3677-4027-b6d5-27558dd7b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1240371146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5029908c7f543a794058e529af72161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=da4f0b68-dac3-4043-8a22-d74f7d324d39,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:49Z,use_quota=True,user_id='4e33d0041ed74b26b18276d5f5a19488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfa7a87-2dd2-47ab-941b-2d896ad57385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfa7a87-2dd2-47ab-941b-2d896ad57385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c1d42a-1d08-4460-a469-34159a0add1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c1d42a-1d08-4460-a469-34159a0add1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1', 'volume_name': 'volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1', 'volume_size': 1, 'source_volid': 'da4f0b68-dac3-4043-8a22-d74f7d324d39', 'source_volstatus': 'available'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234dd796-166e-4a20-8730-0aa2d8bf1d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234dd796-166e-4a20-8730-0aa2d8bf1d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d6fcd2-6ada-403a-b151-ca8c2de8fbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:49 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Volume 89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1', 'volume_size': 1, 'source_volid': 'da4f0b68-dac3-4043-8a22-d74f7d324d39', 'source_volstatus': 'available'}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:49 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa" returned: 0 in 0.521s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.771s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259388086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2aa2677-a028-4688-a445-f6fed7b56125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:46Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Creating volume e2aa2677-a028-4688-a445-f6fed7b56125 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:49 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7ac547-03bc-42a5-b3fa-560f8922c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ce2d55-3187-4610-a5eb-1adae7785d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:49 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125 1073741824
Apr 15 23:27:49 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:49 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa (9fda7a52-6d66-41fc-b112-e2e16b7e81fa): created successfully
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ce2d55-3187-4610-a5eb-1adae7785d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (414ac3d3-347a-4370-9f07-9f0ec9212e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:49 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b0aa6244-95fc-40d6-8197-50174a0bd75a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created volume successfully.
Apr 15 23:27:49 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.433s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:49 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Deleted volume successfully.
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-529f210c-03dd-453a-b1df-e552d74d6683 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-665d1a87-242d-4219-a811-3b6c5df58b02-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:49 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125 1073741824" returned: 0 in 0.498s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:49 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:49 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125
Apr 15 23:27:49 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-8700ec72-e352-4770-875c-5ed7fb8f7823-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-8700ec72-e352-4770-875c-5ed7fb8f7823-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-quobyte-8700ec72-e352-4770-875c-5ed7fb8f7823" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-8700ec72-e352-4770-875c-5ed7fb8f7823" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[36865d83-9279-4395-b932-f165dcb9f0bf]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:50 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125" returned: 0 in 0.435s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.561s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1938189442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9faf1312-03fb-44b2-8fc4-e97ffb4d411f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:46Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Creating volume 9faf1312-03fb-44b2-8fc4-e97ffb4d411f {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:50 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:50 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823
Apr 15 23:27:50 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6704f6be-44fd-4497-b629-8a4c64a7be6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2aa2677-a028-4688-a445-f6fed7b56125', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:50 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f 1073741824
Apr 15 23:27:50 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997250e3-ff0e-43fb-b1c6-96551103289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:50 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume volume-e2aa2677-a028-4688-a445-f6fed7b56125 (e2aa2677-a028-4688-a445-f6fed7b56125): created successfully
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997250e3-ff0e-43fb-b1c6-96551103289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (9a036c66-d307-4352-b7a0-c2e121d00c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:50 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-b1ee3035-b72b-43b2-a75e-88968dc5829a tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created volume successfully.
Apr 15 23:27:50 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:50 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823
Apr 15 23:27:50 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:50 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f 1073741824" returned: 0 in 0.513s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:50 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:50 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f
Apr 15 23:27:50 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:51 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-8700ec72-e352-4770-875c-5ed7fb8f7823" returned: 0 in 0.412s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-8700ec72-e352-4770-875c-5ed7fb8f7823" released by "delete_volume" :: held 0.903s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Created reservations ['26425b9c-ecc7-4f83-a20c-d12d45dd6a53', '7de70722-2b1b-4186-a23b-168ea50ea66a', 'eb071b73-8231-481d-8631-b31e4555e22e', 'f734e2eb-4ff1-4862-91e3-34d2e05d558e'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:51 devstack sudo[90475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:51 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:51 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.299s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1090471624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92901248-ef86-44ca-b370-bcc0ca5def3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:46Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Creating volume 92901248-ef86-44ca-b370-bcc0ca5def3a {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:51 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b2fb21-d3c4-40b0-ad4b-9ff188179ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:51 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a 1073741824
Apr 15 23:27:51 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97da92b4-dfa1-4013-b750-21682f68d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-feddead7-8cb7-4a42-a5be-276aae678dc0-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:51 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f (9faf1312-03fb-44b2-8fc4-e97ffb4d411f): created successfully
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97da92b4-dfa1-4013-b750-21682f68d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (c89d9e19-b3d1-4ba9-b639-46a8961a851d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-472bba05-8e7f-44ed-b960-98361724654d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created volume successfully.
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-feddead7-8cb7-4a42-a5be-276aae678dc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-quobyte-9a743674-303f-4292-9521-83dd8e8148e6" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-9a743674-303f-4292-9521-83dd8e8148e6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-quobyte-feddead7-8cb7-4a42-a5be-276aae678dc0" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-feddead7-8cb7-4a42-a5be-276aae678dc0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Deleting offline snapshot feddead7-8cb7-4a42-a5be-276aae678dc0 of volume 9a743674-303f-4292-9521-83dd8e8148e6 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] snapshot_file for this snap is: volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e4c7d4-3a53-402d-87c4-a30b06f033c0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:51 devstack sudo[90479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0
Apr 15 23:27:51 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:51 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.528s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:51 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Deleted volume successfully.
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-08a2aca6-79e0-497a-9822-adc60078bc0f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-8700ec72-e352-4770-875c-5ed7fb8f7823-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:51 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a 1073741824" returned: 0 in 0.483s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:51 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a
Apr 15 23:27:51 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:51 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0" returned: 0 in 0.525s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:51 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a743674-303f-4292-9521-83dd8e8148e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf7bb7-fd83-4c8a-86e6-50a4e3ccb722]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:52 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6
Apr 15 23:27:52 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:52 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.034s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767127462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b988c3-cb9e-433d-8a8d-fc74dd00072c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac907a7016f4ea384b9512ca918af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:46Z,use_quota=True,user_id='ba6e4dc0b3af42e1b02bce38a9031a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Creating volume 59b988c3-cb9e-433d-8a8d-fc74dd00072c {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:52 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270aad66-c032-48a4-bbc1-51d8acac297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92901248-ef86-44ca-b370-bcc0ca5def3a', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f655df8-47a4-49d7-b2d5-d5b7e8aa06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:52 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c 1073741824
Apr 15 23:27:52 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:52 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume volume-92901248-ef86-44ca-b370-bcc0ca5def3a (92901248-ef86-44ca-b370-bcc0ca5def3a): created successfully
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f655df8-47a4-49d7-b2d5-d5b7e8aa06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (cdab2965-8d1b-4a8c-90a5-8f2703a55656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:52 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-cae37254-1419-45af-b0f3-add8c7230c1d tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created volume successfully.
Apr 15 23:27:52 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6" returned: 0 in 0.477s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:52 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0
Apr 15 23:27:52 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:52 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c 1073741824" returned: 0 in 0.510s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:52 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c
Apr 15 23:27:52 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:52 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0" returned: 0 in 0.481s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:52 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:52 devstack sudo[90508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0
Apr 15 23:27:52 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:53 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c" returned: 0 in 0.422s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.535s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-quobyte-130a4254-b3c5-4b0f-b425-67344c726200-35298433-be77-4de9-b027-228af898b354" by "_create_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0033935-0485-4c2a-bc43-c07af80a8e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d409abd2-2368-41ed-b861-28c5a39b709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-130a4254-b3c5-4b0f-b425-67344c726200-35298433-be77-4de9-b027-228af898b354" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Creating volume 35298433-be77-4de9-b027-228af898b354 from snapshot 130a4254-b3c5-4b0f-b425-67344c726200 {{(pid=81941) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-quobyte-35298433-be77-4de9-b027-228af898b354" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-35298433-be77-4de9-b027-228af898b354" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] snapshot: 130a4254-b3c5-4b0f-b425-67344c726200, volume: 35298433-be77-4de9-b027-228af898b354,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:27:53 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Volume volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c (59b988c3-cb9e-433d-8a8d-fc74dd00072c): created successfully
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d409abd2-2368-41ed-b861-28c5a39b709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Flow 'volume_create_manager' (db954ee6-6690-499b-9df6-97914f775744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c5fc9a-e006-4719-88b2-43062f264533]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:53 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-9b3af454-bb46-4a29-a527-9c174ee1d2d0 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created volume successfully.
Apr 15 23:27:53 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6.feddead7-8cb7-4a42-a5be-276aae678dc0" returned: 0 in 0.425s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:53 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200
Apr 15 23:27:53 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-feddead7-8cb7-4a42-a5be-276aae678dc0" released by "_delete_snapshot" :: held 1.963s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-9a743674-303f-4292-9521-83dd8e8148e6" released by "delete_snapshot" :: held 1.979s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Created reservations ['bace3252-9513-4e48-b8cb-74f47ab35998', 'e0a36b0e-bd53-43de-b3d5-ca22a378a5b0', '180191a1-97ed-429c-908e-8eec04eedf7c', '8d2de919-b1f0-48d6-ad64-a3dabb4082ae'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:53 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Delete snapshot completed successfully.
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c0c8ef38-d78d-4786-b06a-617455082d80 tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-feddead7-8cb7-4a42-a5be-276aae678dc0-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-59b988c3-cb9e-433d-8a8d-fc74dd00072c-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-59b988c3-cb9e-433d-8a8d-fc74dd00072c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-quobyte-59b988c3-cb9e-433d-8a8d-fc74dd00072c" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:53 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200" returned: 0 in 0.483s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-59b988c3-cb9e-433d-8a8d-fc74dd00072c" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[853c0f5b-6d18-47c3-9809-944822a3e4cc]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b33a7d-060f-42c4-bbcc-420680655a61]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:53 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:53 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9
Apr 15 23:27:53 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:53 devstack sudo[90518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c
Apr 15 23:27:53 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:54 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:54 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c" returned: 0 in 0.484s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:54 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354
Apr 15 23:27:54 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:54 devstack sudo[90529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c
Apr 15 23:27:54 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-9a743674-303f-4292-9521-83dd8e8148e6-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-9a743674-303f-4292-9521-83dd8e8148e6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "cinder-quobyte-9a743674-303f-4292-9521-83dd8e8148e6" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-9a743674-303f-4292-9521-83dd8e8148e6" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b59b67-0be0-47ed-bd72-f05cc76e72a8]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:54 devstack sudo[90531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6
Apr 15 23:27:54 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:54 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-59b988c3-cb9e-433d-8a8d-fc74dd00072c" returned: 0 in 0.516s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-59b988c3-cb9e-433d-8a8d-fc74dd00072c" released by "delete_volume" :: held 1.051s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:54 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created reservations ['8d9dd0c1-83db-4926-85ba-53ae5731d848', '8a572245-f9a1-48e7-bb7e-0121bfa3b761', '65785176-4d44-485a-8a8a-392a7752af8c', '297351e3-6787-4782-a5c6-af3df7e8f1cb'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:55 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:55 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:55 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:55 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:56 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6" returned: 0 in 1.547s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:56 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-92901248-ef86-44ca-b370-bcc0ca5def3a-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 1.153s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:56 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6
Apr 15 23:27:56 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-92901248-ef86-44ca-b370-bcc0ca5def3a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:56 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Deleted volume successfully.
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c3a73473-8290-430e-9569-b6bc15f98df8 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-59b988c3-cb9e-433d-8a8d-fc74dd00072c-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-quobyte-92901248-ef86-44ca-b370-bcc0ca5def3a" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-92901248-ef86-44ca-b370-bcc0ca5def3a" acquired by "delete_volume" :: waited 0.018s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e67fb61-487b-4ca5-965e-f9f0f5fe5f26]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:56 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a
Apr 15 23:27:56 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:56 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354" returned: 0 in 2.223s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b057c8-009b-4e2a-a8b7-73c206a2e784]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:56 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9
Apr 15 23:27:56 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:56 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9a743674-303f-4292-9521-83dd8e8148e6" returned: 0 in 0.664s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-quobyte-9a743674-303f-4292-9521-83dd8e8148e6" released by "delete_volume" :: held 2.244s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Created reservations ['72401234-e61e-432e-a923-f48670ba6cb9', '384c1ab6-cb22-48f5-99d9-a1298c0ce73c', 'dada63f8-5c83-4016-b2d5-efaaf7ad0e2b', '068c785c-e292-4467-be85-2a32c51e43fb'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:56 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:56 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:56 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a" returned: 0 in 0.528s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:56 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:56 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a
Apr 15 23:27:56 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:57 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" returned: 0 in 0.614s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:27:57 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Converted 1024.00 MB image at 460.35 MB/s
Apr 15 23:27:57 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354 is being set with open permissions: ugo+rw
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:57 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354
Apr 15 23:27:57 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_service.periodic_task [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81941) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:57 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:57 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:57 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.417s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Deleted volume successfully.
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-40a147f3-4068-4459-9206-cefff3f7799f tempest-CreateVolumesFromSnapshotTest-248631578 None] Lock "cinder-9a743674-303f-4292-9521-83dd8e8148e6-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:57 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-92901248-ef86-44ca-b370-bcc0ca5def3a" returned: 0 in 0.462s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-92901248-ef86-44ca-b370-bcc0ca5def3a" released by "delete_volume" :: held 1.028s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created reservations ['acb16202-0694-4fc5-94e3-b8e7b0ad0e85', '5da82dda-8e6e-4f6d-892a-73aa236f32a6', '2c02883e-e4f3-498e-af63-4208cef82336', '0c685aa1-11f0-443f-bb46-680c6dbe1f4f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:57 devstack sudo[90575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:57 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:57 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354" returned: 0 in 0.418s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-35298433-be77-4de9-b027-228af898b354" released by "_copy_volume_from_snapshot" :: held 4.293s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-130a4254-b3c5-4b0f-b425-67344c726200-35298433-be77-4de9-b027-228af898b354" released by "_create_volume_from_snapshot" :: held 4.309s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.329s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.210s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:57 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Cloning volume da4f0b68-dac3-4043-8a22-d74f7d324d39 to volume 89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6b9e26-b4b0-41b2-b8f3-b6c0331fa5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35298433-be77-4de9-b027-228af898b354', 'volume_size': 1, 'snapshot_id': '130a4254-b3c5-4b0f-b425-67344c726200'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5d1e0e-e6b0-47de-b641-13f177d04f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:57 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Volume volume-35298433-be77-4de9-b027-228af898b354 (35298433-be77-4de9-b027-228af898b354): created successfully
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5d1e0e-e6b0-47de-b641-13f177d04f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Flow 'volume_create_manager' (ccf19dd4-cb57-46ad-a2ff-49a262472171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Creating offline snapshot d8871ed6-5937-4307-9931-fdc098fd30c9 of volume da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:27:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e7eaa015-998e-4076-ae73-e7cb2e997968 tempest-SnapshotDependencyTests-608744464 None] Created volume successfully.
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[97343490-db78-4556-968b-efb11c3e54ba]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:57 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.477s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8618890d-dab8-49b1-8b36-c82d27b02552 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:57 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39
Apr 15 23:27:57 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:57 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:27:57 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Deleted volume successfully.
Apr 15 23:27:57 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-02c1811c-7cf5-48ac-a3e9-3e6d52cf9f76 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-92901248-ef86-44ca-b370-bcc0ca5def3a-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:58 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39" returned: 0 in 0.511s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:58 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 1G
Apr 15 23:27:58 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-130a4254-b3c5-4b0f-b425-67344c726200-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-130a4254-b3c5-4b0f-b425-67344c726200-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-quobyte-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-quobyte-130a4254-b3c5-4b0f-b425-67344c726200" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-130a4254-b3c5-4b0f-b425-67344c726200" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Deleting offline snapshot 130a4254-b3c5-4b0f-b425-67344c726200 of volume 9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] snapshot_file for this snap is: volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[464e1839-e7ea-4fda-819e-c038544d07ea]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:58 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200
Apr 15 23:27:58 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-9faf1312-03fb-44b2-8fc4-e97ffb4d411f-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-9faf1312-03fb-44b2-8fc4-e97ffb4d411f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-quobyte-9faf1312-03fb-44b2-8fc4-e97ffb4d411f" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-9faf1312-03fb-44b2-8fc4-e97ffb4d411f" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[447efca8-d877-40d9-8cc3-9a48ba7630cc]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:58 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f
Apr 15 23:27:58 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:58 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 1G" returned: 0 in 0.640s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:58 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9
Apr 15 23:27:58 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:58 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200" returned: 0 in 0.628s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3d9beb-5f8e-4697-b774-51fd34a98935]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:27:58 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:59 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9
Apr 15 23:27:59 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:59 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f" returned: 0 in 0.584s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:59 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f
Apr 15 23:27:59 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:59 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9" returned: 0 in 0.485s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:59 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 is being set with open permissions: ugo+rw
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:59 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9
Apr 15 23:27:59 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:59 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:UPDATE=248,cinder:SELECT=168,cinder:DELETE=26,cinder:INSERT=54 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" returned: 0 in 0.667s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:UPDATE=261,cinder:DELETE=23,cinder:SELECT=191,cinder:INSERT=65 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Flow 'volume_create_manager' (8d36997c-7f83-4217-9ec4-c9343d7f2d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:27:59 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200
Apr 15 23:27:59 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7c577b-07f9-408b-91e6-d44010124694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7c577b-07f9-408b-91e6-d44010124694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2f8931-6508-4d61-be99-1b4291309b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82923bebbaeb41c38f647d460287a205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:28:00Z,use_quota=True,user_id='45a2f98e8af34dc9b20d67bf1979b307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fbe8f1-2b9e-4352-85f9-7cc18848ad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fbe8f1-2b9e-4352-85f9-7cc18848ad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:59 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6592e3a3-d112-4e7f-b79b-45bde7a3a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6592e3a3-d112-4e7f-b79b-45bde7a3a148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2f8931-6508-4d61-be99-1b4291309b5e', 'volume_name': 'volume-7e2f8931-6508-4d61-be99-1b4291309b5e', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ef2cf6-3d6c-4093-9806-b4fb0380a470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ef2cf6-3d6c-4093-9806-b4fb0380a470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ef5def-9dec-4d7d-9c08-f255ebf3b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:27:59 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Volume 7e2f8931-6508-4d61-be99-1b4291309b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2f8931-6508-4d61-be99-1b4291309b5e', 'volume_size': 1}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9faf1312-03fb-44b2-8fc4-e97ffb4d411f" returned: 0 in 0.586s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-9faf1312-03fb-44b2-8fc4-e97ffb4d411f" released by "delete_volume" :: held 1.192s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created reservations ['0c97c90e-dd95-43a1-9bd3-96763a3038ed', 'e70044c1-c78c-4a4d-8613-3d65f09c4fa8', '9a631ce4-1ae8-41b0-b41c-b58532c80749', 'f2270fd4-f101-485f-8c1a-0f6ced67d470'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:27:59 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9" returned: 0 in 0.531s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:27:59 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:27:59 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:27:59 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:27:59 devstack sudo[90620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.info
Apr 15 23:27:59 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:00 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200" returned: 0 in 0.520s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:00 devstack sudo[90626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200
Apr 15 23:28:00 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:00 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.426s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:00 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Deleted volume successfully.
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a191d8a5-bc90-4155-9afb-c9a2a272e5c7 tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-9faf1312-03fb-44b2-8fc4-e97ffb4d411f-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:00 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.info" returned: 0 in 0.436s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:00 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.info is being set with open permissions: ugo+rw
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:00 devstack sudo[90629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.info
Apr 15 23:28:00 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:00 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9.130a4254-b3c5-4b0f-b425-67344c726200" returned: 0 in 0.413s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-130a4254-b3c5-4b0f-b425-67344c726200" released by "_delete_snapshot" :: held 2.293s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" released by "delete_snapshot" :: held 2.309s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Created reservations ['15175927-f6da-45de-93cd-6c883e0b10ff', 'd4e94122-caeb-43d2-93ee-d7501bcf017e', 'ef835dc3-f0ad-4c19-9056-0b8dfc5f0c1d', 'cb4e5c87-2652-4a90-8678-0d6ea9f99e13'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:00 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Delete snapshot completed successfully.
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-dd26abfd-67cc-48be-a454-d15de8085448 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-130a4254-b3c5-4b0f-b425-67344c726200-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-e2aa2677-a028-4688-a445-f6fed7b56125-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-e2aa2677-a028-4688-a445-f6fed7b56125-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:00 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.info" returned: 0 in 0.455s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" by "_copy_volume_from_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-quobyte-e2aa2677-a028-4688-a445-f6fed7b56125" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] snapshot: d8871ed6-5937-4307-9931-fdc098fd30c9, volume: 89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1,  {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-e2aa2677-a028-4688-a445-f6fed7b56125" acquired by "delete_volume" :: waited 0.025s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[9664c0b3-9b76-4130-a63f-de0d6fc7ca97]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[e869e703-08cf-4df0-a842-4d0bcb05f3b0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:00 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:00 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9
Apr 15 23:28:00 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:00 devstack sudo[90634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125
Apr 15 23:28:00 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:01 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125" returned: 0 in 0.463s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:01 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9" returned: 0 in 0.491s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4f0b68-dac3-4043-8a22-d74f7d324d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Creating direct copy from snapshot {{(pid=81941) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 23:28:01 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125
Apr 15 23:28:01 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5fb98c-a137-4b4d-a6d6-c4ed23f3fa5f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:01 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39
Apr 15 23:28:01 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-quobyte-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" acquired by "delete_volume" :: waited 0.006s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ad32b-e23f-424e-a6a6-d656bbe8e974]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:01 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9
Apr 15 23:28:01 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:01 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-e2aa2677-a028-4688-a445-f6fed7b56125" returned: 0 in 0.397s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-e2aa2677-a028-4688-a445-f6fed7b56125" released by "delete_volume" :: held 0.888s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created reservations ['f0e30c44-b93c-4c8f-b24e-8f5807ac781b', '5001105a-7fe8-4719-b433-80f5bb19f319', '9c834f1c-ee42-4e59-8f0e-b6bfd230a0d6', '014c7cdf-6dd0-47f5-a80a-7d9f85c35611'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:01 devstack sudo[90653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:01 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:01 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39" returned: 0 in 0.529s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.utils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Path /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1 not found in is_blk_device check {{(pid=81941) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-9fda7a52-6d66-41fc-b112-e2e16b7e81fa-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:01 devstack sudo[90655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-9fda7a52-6d66-41fc-b112-e2e16b7e81fa-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:01 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-quobyte-9fda7a52-6d66-41fc-b112-e2e16b7e81fa" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-9fda7a52-6d66-41fc-b112-e2e16b7e81fa" acquired by "delete_volume" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf747c0-4368-41fc-8411-cc23d625d4c2]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:01 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" returned: 0 in 0.503s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:01 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:02 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9
Apr 15 23:28:02 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:02 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa
Apr 15 23:28:02 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:02 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.474s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:02 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Deleted volume successfully.
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-8467d9de-3346-4399-9365-3182c3f65d5e tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-e2aa2677-a028-4688-a445-f6fed7b56125-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:02 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9" released by "delete_volume" :: held 0.992s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:02 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa" returned: 0 in 0.558s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:02 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa
Apr 15 23:28:02 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Created reservations ['29339d8e-b5f5-4032-b4a1-4190c1fe06d6', '1cdfd4f5-1a81-46c5-b81b-39a12f17645d', '413c3dd8-978c-4243-8aa9-f18513f80b54', 'f8e4dd95-9b87-4537-bbbc-acde7689307d'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:02 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:02 devstack sudo[90683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:02 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:03 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 1.064s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:03 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:03 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Deleted volume successfully.
Apr 15 23:28:03 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-35298433-be77-4de9-b027-228af898b354-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:03 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-9fda7a52-6d66-41fc-b112-e2e16b7e81fa" returned: 0 in 1.424s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-9fda7a52-6d66-41fc-b112-e2e16b7e81fa" released by "delete_volume" :: held 2.032s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3e1bd6a2-71d4-472b-987f-381a7878e9f8 tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-9f77fd8e-0f06-4822-b041-e8e6b6e26bc9-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:03 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-35298433-be77-4de9-b027-228af898b354-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "cinder-quobyte-35298433-be77-4de9-b027-228af898b354" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created reservations ['92db5ef1-22a0-4fb4-aedc-baa214a3eae2', 'ff70ee5a-e1d0-43ce-a72c-a416de6b579e', '1c32cee2-960b-4551-b10e-7ac52a70e9ea', '68ae021d-822f-43aa-a68d-4c4f754bdde3'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-35298433-be77-4de9-b027-228af898b354" acquired by "delete_volume" :: waited 0.021s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c312ae1-3664-4909-92c6-1f812e8d51cc]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:04 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:04 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:04 devstack sudo[90687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354
Apr 15 23:28:04 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:04 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" returned: 0 in 2.472s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab85951-8026-47b4-aea6-009b7d1b5e01]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:04 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39
Apr 15 23:28:04 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:04 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:04 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354" returned: 0 in 0.561s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.422s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:04 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354
Apr 15 23:28:04 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:04 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Deleted volume successfully.
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e382efd4-a65a-49c9-9177-19a741a5c1eb tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-9fda7a52-6d66-41fc-b112-e2e16b7e81fa-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:04 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39" returned: 0 in 0.624s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Image conversion details: src /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1 {{(pid=81941) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 23:28:04 devstack cinder-volume[81941]: INFO cinder.image.image_utils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Converted 1024.00 MB image at 413.99 MB/s
Apr 15 23:28:04 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1 is being set with open permissions: ugo+rw
Apr 15 23:28:04 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:04 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1
Apr 15 23:28:04 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:05 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-35298433-be77-4de9-b027-228af898b354" returned: 0 in 0.440s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-quobyte-35298433-be77-4de9-b027-228af898b354" released by "delete_volume" :: held 1.088s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Created reservations ['bcbd7599-1d09-453b-a123-b13fb997ee93', '1eb206a2-687c-4cf1-a438-54c37979b537', '3dda7c3d-48c2-42a0-a734-88507fa21bd7', '76fae2a0-b759-4151-a27a-0d7d6274564b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:05 devstack sudo[90705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:05 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-b1774301-b8c5-40bc-8172-a6ed64dd00d5-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-b1774301-b8c5-40bc-8172-a6ed64dd00d5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "cinder-quobyte-b1774301-b8c5-40bc-8172-a6ed64dd00d5" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-b1774301-b8c5-40bc-8172-a6ed64dd00d5" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a23a7-a5cc-48fd-aa4b-60cbe2b1862b]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:05 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5
Apr 15 23:28:05 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:05 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" returned: 0 in 0.464s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" released by "_copy_volume_from_snapshot" :: held 4.641s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-d8871ed6-5937-4307-9931-fdc098fd30c9" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-d8871ed6-5937-4307-9931-fdc098fd30c9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Deleting offline snapshot d8871ed6-5937-4307-9931-fdc098fd30c9 of volume da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] snapshot_file for this snap is: volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ff0a82-6424-4cc7-93f6-caf83a7d58a0]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:05 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9
Apr 15 23:28:05 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:05 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.450s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:05 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Deleted volume successfully.
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-3105a0ab-aeed-4cbc-bbbc-108a370578ef tempest-SnapshotDependencyTests-608744464 None] Lock "cinder-35298433-be77-4de9-b027-228af898b354-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:05 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5" returned: 0 in 0.468s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:05 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5
Apr 15 23:28:05 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:05 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9" returned: 0 in 0.477s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4f0b68-dac3-4043-8a22-d74f7d324d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35258fb-443d-45de-8997-d9a49326177c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:05 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:06 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39
Apr 15 23:28:06 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:06 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b1774301-b8c5-40bc-8172-a6ed64dd00d5" returned: 0 in 0.452s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-quobyte-b1774301-b8c5-40bc-8172-a6ed64dd00d5" released by "delete_volume" :: held 0.947s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Created reservations ['9843a464-ca17-4896-bdda-9698d06d3839', '17787086-f949-423e-9dfc-1922f544ecc7', '662a67a3-1446-4711-af95-1c49afa1d449', 'e8f7f88f-9277-4597-b030-a16ca80a88f0'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:06 devstack sudo[90725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:06 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:06 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39" returned: 0 in 0.620s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:06 devstack sudo[90730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9
Apr 15 23:28:06 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:06 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.518s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:06 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Deleted volume successfully.
Apr 15 23:28:06 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-4e3a4a1b-1ea3-452d-8def-fb80f73cd75c tempest-CreateVolumesFromSourceVolumeTest-1951306322 None] Lock "cinder-b1774301-b8c5-40bc-8172-a6ed64dd00d5-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:07 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9" returned: 0 in 0.625s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:07 devstack sudo[90736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9
Apr 15 23:28:07 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:07 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39.d8871ed6-5937-4307-9931-fdc098fd30c9" returned: 0 in 0.477s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-d8871ed6-5937-4307-9931-fdc098fd30c9" released by "_delete_snapshot" :: held 2.245s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.119s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.975s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2f8931-6508-4d61-be99-1b4291309b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82923bebbaeb41c38f647d460287a205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:28:00Z,use_quota=True,user_id='45a2f98e8af34dc9b20d67bf1979b307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Creating volume 7e2f8931-6508-4d61-be99-1b4291309b5e {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:28:07 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d6fcd2-6ada-403a-b151-ca8c2de8fbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1', 'volume_size': 1, 'source_volid': 'da4f0b68-dac3-4043-8a22-d74f7d324d39', 'source_volstatus': 'available'}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:07 devstack sudo[90740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e 1073741824
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b00218-b32b-4adf-b261-f619f378391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:28:07 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:07 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Volume volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1 (89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1): created successfully
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b00218-b32b-4adf-b261-f619f378391a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:07 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Flow 'volume_create_manager' (3f78b93c-b58d-475e-a76f-65332c73eefa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:28:07 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-fcc47714-934b-4ad9-866f-60ee59426bf3 tempest-VolumeDependencyTests-1245287785 None] Created volume successfully.
Apr 15 23:28:08 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e 1073741824" returned: 0 in 0.549s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:08 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e
Apr 15 23:28:08 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-da4f0b68-dac3-4043-8a22-d74f7d324d39-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-da4f0b68-dac3-4043-8a22-d74f7d324d39-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-da4f0b68-dac3-4043-8a22-d74f7d324d39" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-da4f0b68-dac3-4043-8a22-d74f7d324d39" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1bdf20-738a-422c-9cd2-59cbe934a50a]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:08 devstack sudo[90749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39
Apr 15 23:28:08 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:08 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e" returned: 0 in 0.527s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ef5def-9dec-4d7d-9c08-f255ebf3b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2f8931-6508-4d61-be99-1b4291309b5e', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69107847-1bed-426c-818d-ae1a47eccebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:28:08 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Volume volume-7e2f8931-6508-4d61-be99-1b4291309b5e (7e2f8931-6508-4d61-be99-1b4291309b5e): created successfully
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69107847-1bed-426c-818d-ae1a47eccebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:08 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Flow 'volume_create_manager' (8d36997c-7f83-4217-9ec4-c9343d7f2d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:28:08 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-5c64bb6e-9674-4c60-a8a9-1525df91044d tempest-CinderUnicodeTest-771121507 None] Created volume successfully.
Apr 15 23:28:09 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39" returned: 0 in 0.509s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:09 devstack sudo[90754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39
Apr 15 23:28:09 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.flows.manager.create_volume [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81941) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Flow 'volume_create_manager' (a533c8b6-bc8f-4e45-9ae0-ad146c3a0f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6060f7f-9f97-4de7-8103-0c736e7cdeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6060f7f-9f97-4de7-8103-0c736e7cdeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:28:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-931246063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ea3669-af3c-4f85-bc2a-43c2a33ecc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82923bebbaeb41c38f647d460287a205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:28:10Z,use_quota=True,user_id='45a2f98e8af34dc9b20d67bf1979b307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bfe912-f390-4525-877f-4f414f287ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bfe912-f390-4525-877f-4f414f287ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47a4640-3b8b-4146-86e1-ad68f465bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47a4640-3b8b-4146-86e1-ad68f465bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ea3669-af3c-4f85-bc2a-43c2a33ecc27', 'volume_name': 'volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91265cf6-41cb-4627-870a-13a0eb6c1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91265cf6-41cb-4627-870a-13a0eb6c1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:09 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7516273c-f833-4964-849c-96ffcf9a5816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:28:09 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Volume 60ea3669-af3c-4f85-bc2a-43c2a33ecc27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27', 'volume_size': 1}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f115681b340>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T21:28:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-931246063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ea3669-af3c-4f85-bc2a-43c2a33ecc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82923bebbaeb41c38f647d460287a205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:28:10Z,use_quota=True,user_id='45a2f98e8af34dc9b20d67bf1979b307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5fbf279-8de7-4ef4-ab9f-51a96c821d31),volume_type_id=e5fbf279-8de7-4ef4-ab9f-51a96c821d31)}" {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Creating volume 60ea3669-af3c-4f85-bc2a-43c2a33ecc27 {{(pid=81941) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Selected osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31 as target Quobyte volume. {{(pid=81941) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 23:28:09 devstack cinder-volume[81941]: INFO cinder.volume.drivers.remotefs [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] casted to osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 1073741824 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-da4f0b68-dac3-4043-8a22-d74f7d324d39" returned: 0 in 0.524s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:09 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 1073741824
Apr 15 23:28:09 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-da4f0b68-dac3-4043-8a22-d74f7d324d39" released by "delete_volume" :: held 1.077s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Created reservations ['5392f68b-dbe2-4de5-813a-112ef312f2c2', '5e6a8d8a-9c07-4ce4-8677-39a9da03b733', '226194ff-b3f6-4dc4-a34c-61ffc02c74dd', 'e1a3ddfe-11a4-4575-bd98-65bd7769d85f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:09 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:09 devstack sudo[90760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:09 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:10 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.450s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:10 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 1073741824" returned: 0 in 0.570s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:10 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Deleted volume successfully.
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a45429d8-8930-4e3b-a353-a5a19ee2cda8 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-da4f0b68-dac3-4043-8a22-d74f7d324d39-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:10 devstack sudo[90767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27
Apr 15 23:28:10 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:10 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'} {{(pid=81941) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7516273c-f833-4964-849c-96ffcf9a5816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27', 'volume_size': 1}' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f72e8f-a025-4ad3-9400-019de4f90413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 23:28:10 devstack cinder-volume[81941]: INFO cinder.volume.flows.manager.create_volume [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Volume volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 (60ea3669-af3c-4f85-bc2a-43c2a33ecc27): created successfully
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f72e8f-a025-4ad3-9400-019de4f90413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81941) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Flow 'volume_create_manager' (a533c8b6-bc8f-4e45-9ae0-ad146c3a0f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81941) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:10 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-7830166f-417e-446f-a15d-6d089dd7b031 tempest-CinderUnicodeTest-771121507 None] Created volume successfully.
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[2947d1c0-6f98-409e-99d0-cbcb69574f4c]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:10 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:10 devstack sudo[90770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1
Apr 15 23:28:10 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:11 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" returned: 0 in 0.521s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:11 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1
Apr 15 23:28:11 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Creating offline snapshot e8268205-a773-4fa1-b571-0a670085206e of volume 60ea3669-af3c-4f85-bc2a-43c2a33ecc27 {{(pid=81941) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb148f9-ab50-4001-9169-ce04dc109060]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:11 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" returned: 0 in 0.551s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:11 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27
Apr 15 23:28:11 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:11 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1" released by "delete_volume" :: held 1.097s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Created reservations ['fb0c26ff-e407-466b-8236-087b3bace8dd', '2184e689-0e5e-4845-8b86-d21bec391175', 'de51de5c-29b5-4cdf-8510-53c32eafd7ee', 'b8dc20bd-2a30-48f2-a63b-bbdfd2605d8b'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:12 devstack sudo[90781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:12 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:12 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" returned: 0 in 0.503s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e 1G {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:12 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e 1G
Apr 15 23:28:12 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:12 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.421s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:12 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Deleted volume successfully.
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-90ed8610-f34d-4854-98a4-427e06e1f8fd tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-89fe55a0-ff25-4e2b-aa85-e4172fa7e3a1-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:12 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e 1G" returned: 0 in 0.495s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:12 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:12 devstack sudo[90792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e
Apr 15 23:28:12 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "cinder-quobyte-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" acquired by "delete_volume" :: waited 0.013s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[667eea16-67fe-4384-88ba-97632e72cf7f]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:13 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651
Apr 15 23:28:13 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:13 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 -F qcow2 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e" returned: 0 in 0.453s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:13 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e is being set with open permissions: ugo+rw
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:13 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e
Apr 15 23:28:13 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:13 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" returned: 0 in 0.474s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:13 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651
Apr 15 23:28:13 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:13 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e" returned: 0 in 0.403s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:13 devstack sudo[90807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.info
Apr 15 23:28:13 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:13 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" returned: 0 in 0.413s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:13 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-quobyte-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651" released by "delete_volume" :: held 0.908s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Created reservations ['70fa359d-f513-421c-a070-99865c71d306', 'abcd54ec-ec68-4fca-b1bc-700b9b1cc81c', 'a1112b7c-c47c-4191-91a0-eac861a15fb5', '37f39f28-a4f9-4fed-baae-005ba0df126f'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:14 devstack sudo[90812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:14 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:14 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.info" returned: 0 in 0.448s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:14 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.remotefs [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.info is being set with open permissions: ugo+rw
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.info {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:14 devstack sudo[90815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.info
Apr 15 23:28:14 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:14 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.476s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:14 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Deleted volume successfully.
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-c02cabe4-f8a1-4ad3-bc97-2828301ede48 tempest-VolumeDependencyTests-1245287785 None] Lock "cinder-b6440cfa-1fe8-43d1-9b94-9ca3b13d8651-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:14 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.info" returned: 0 in 0.456s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:14 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:14 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-0bde000d-82e9-4903-8ae8-724a9dd12741 tempest-CinderUnicodeTest-771121507 None] Create snapshot completed successfully
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "cinder-e8268205-a773-4fa1-b571-0a670085206e-delete_snapshot" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-e8268205-a773-4fa1-b571-0a670085206e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "cinder-quobyte-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" by "delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-quobyte-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "cinder-quobyte-e8268205-a773-4fa1-b571-0a670085206e" by "_delete_snapshot" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-quobyte-e8268205-a773-4fa1-b571-0a670085206e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Deleting offline snapshot e8268205-a773-4fa1-b571-0a670085206e of volume 60ea3669-af3c-4f85-bc2a-43c2a33ecc27 {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] snapshot_file for this snap is: volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e {{(pid=81941) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a5635-7215-482e-a2d1-49765aca3d86]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:15 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e
Apr 15 23:28:15 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:15 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e" returned: 0 in 0.479s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81941) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[871fc794-21db-47af-a079-e180a01b05dd]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:15 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:15 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27
Apr 15 23:28:15 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:16 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" returned: 0 in 0.474s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:16 devstack sudo[90830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e
Apr 15 23:28:16 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:16 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e" returned: 0 in 0.445s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:16 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e
Apr 15 23:28:16 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:16 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27.e8268205-a773-4fa1-b571-0a670085206e" returned: 0 in 0.420s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-quobyte-e8268205-a773-4fa1-b571-0a670085206e" released by "_delete_snapshot" :: held 1.877s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-quobyte-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" released by "delete_snapshot" :: held 1.889s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Created reservations ['3503d5e4-3571-48ea-8b6c-09711e1ff0f2', '124aa3ca-9680-4c14-83cc-e2e45e2d8064', '39535214-3e80-4985-8d82-46f268a738d2', '9e2fd8f9-a60e-4980-8f21-c82e4473ebe3'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:16 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Delete snapshot completed successfully.
Apr 15 23:28:16 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-43d08997-a8e4-45d2-a38a-744fa43f50e9 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-e8268205-a773-4fa1-b571-0a670085206e-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:17 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Acquiring lock "cinder-60ea3669-af3c-4f85-bc2a-43c2a33ecc27-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:17 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Lock "cinder-60ea3669-af3c-4f85-bc2a-43c2a33ecc27-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:17 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Acquiring lock "cinder-quobyte-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:17 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Lock "cinder-quobyte-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:17 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc03fe23-83d5-448a-8243-6b7e62760883]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:17 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27
Apr 15 23:28:17 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:17 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" returned: 0 in 0.443s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:17 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:17 devstack sudo[90843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27
Apr 15 23:28:17 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:18 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" returned: 0 in 0.403s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Lock "cinder-quobyte-60ea3669-af3c-4f85-bc2a-43c2a33ecc27" released by "delete_volume" :: held 0.874s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Created reservations ['13ff0409-af9c-4059-a9b4-3a414432b116', 'b4a5c2ab-275b-4bca-84de-987b4f20f8df', 'a9967a2b-d475-4272-9859-3bf12fd521e4', 'ac987398-65a1-4c3d-b8b9-214bf0924c98'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:18 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:18 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "cinder-7e2f8931-6508-4d61-be99-1b4291309b5e-delete_volume" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-7e2f8931-6508-4d61-be99-1b4291309b5e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "cinder-quobyte-7e2f8931-6508-4d61-be99-1b4291309b5e" by "delete_volume" {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-quobyte-7e2f8931-6508-4d61-be99-1b4291309b5e" acquired by "delete_volume" :: waited 0.008s {{(pid=81941) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo.privsep.daemon [-] privsep: reply[3130fd23-8c0d-46d2-8dd9-c2397aca9927]: (4, 'qcow2') {{(pid=82763) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:18 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e
Apr 15 23:28:18 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:18 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.420s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:18 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Deleted volume successfully.
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-a88099b8-3112-4627-a86b-daa6135b495f tempest-CinderUnicodeTest-771121507 None] Lock "cinder-60ea3669-af3c-4f85-bc2a-43c2a33ecc27-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:18 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e" returned: 0 in 0.473s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:18 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:18 devstack sudo[90854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e
Apr 15 23:28:18 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:19 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac/volume-7e2f8931-6508-4d61-be99-1b4291309b5e" returned: 0 in 0.396s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-quobyte-7e2f8931-6508-4d61-be99-1b4291309b5e" released by "delete_volume" :: held 0.897s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG cinder.quota [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Created reservations ['0d6343c8-d58a-4364-a6d9-0f76aa9533d5', 'f889dc8d-f5ab-48d8-b1e3-07630821c7cd', 'fca2ccd9-fc82-4f36-b766-8200552c8f55', '05ec76fd-04f4-4742-b140-31d5b774d513'] {{(pid=81941) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0dc8ba2b-a2f7-4a28-aa64-4ce0ade37c31'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 23:28:19 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac
Apr 15 23:28:19 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 23:28:19 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/930b9f3e4fe2f1d90945c9d7afeb04ac" returned: 0 in 0.429s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 23:28:19 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Deleted volume successfully.
Apr 15 23:28:19 devstack cinder-volume[81941]: DEBUG cinder.coordination [None req-e79348e1-428e-4b0b-8702-a4bc2d721195 tempest-CinderUnicodeTest-771121507 None] Lock "cinder-7e2f8931-6508-4d61-be99-1b4291309b5e-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=81941) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 23:28:29 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=84,cinder:INSERT=29,cinder:UPDATE=131,cinder:DELETE=6 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 23:28:29 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writing DB stats cinder:SELECT=64,cinder:INSERT=28,cinder:UPDATE=88,cinder:DELETE=9 {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}